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PREFACE 


I  spent  the  2015  aeademic  year  as  an  Air  Force  Foreign  Policy 
Fellow  with  the  State  Department  and  Georgetown  University.  1  used  part 
of  my  fellowship  to  research  and  write  on  a  topic  that  most  in 
Washington  agreed  was  an  important  issue,  but  few  could  describe  the 
link  between  violent  extremism  and  social  media.  Leaders  in  the 
Pentagon,  the  NSC,  and  the  State  Department  would  wax  poetic  that  we 
had  to  “fight  them  on  social  media,”  and  we  had  to  “change  the 
narrative”  to  win  the  Twitter  war  with  ISIS.  I  quickly  realized  that  most 
of  the  people  advocating  that  position  knew  some  things  about  ISIS  but 
absolutely  nothing  about  social  media. 

Ultimately,  my  paper  was  a  rebuke  of  the  social  media 
methodologies  of  the  United  States  government  at  the  time.  The  State 
Department  attempted  to  create  an  expensive  social  media  ad  campaign 
to  find  ISIS  Twitter  accounts  and  essentially  argue  with  them  on  the  finer 
points  of  their  religion.  Meanwhile,  ISIS  was  using  an  impressive 
combination  of  high-  and  low-tech  solutions  to  dominate  social  media. 
Put  simply,  ISIS  was  using  others  to  spread  their  message  for  them — 
including  the  unwitting  Western  media.  That  paper’s  thesis  thus  became: 
we  should  use  their  playbook.  I  have  revised  and  included  a  small 
portion  of  that  research  in  this  paper. 

Around  the  time  I  started  my  research,  I  read  an  article  in  The  New 
York  Times  about  a  professional  network  of  internet  “trolls”  in  Russia.  An 
internet  troll  is  someone  who  writes — t5qjically  on  social  media  and  in 
news  comment  sections — for  the  exclusive  purpose  of  creating  mischief. 
Trolls  are  usually  rude,  vulgar,  and  have  no  regard  for  conversation. 

Their  only  goal  is  to  insert  their  opinion  aggressively  into  the  discussion. 
The  Russian  government,  according  to  the  article,  hired  the  trolls  to 
create  panic  and  distrust  in  the  institutions  of  the  United  States. 
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Shortly  after  I  read  the  artiele,  my  undergraduate  alma  mater,  the 
University  of  Missouri,  went  through  a  diffieult  period  of  raeial  strife  on 
eampus  that  generated  signifieant  media  attention.  I  began  to  reeognize 
some  of  the  teehniques  of  the  Russian  trolls  from  the  Times  artiele.  I  took 
note  of  partieular  Twitter  handles  to  monitor  over  the  next  several 
months.  Over  time,  I  watehed  as  the  Russian  troll  network  morphed  from 
one  event  to  another.  It  changed  so  dramatically  that  I  nearly  changed 
my  research  topic  to  write  on  that  evolution  alone.  With  the  political 
morphing,  I  also  noticed  a  slight  change  in  techniques.  They  too  had 
learned  from  ISIS  and  were  unleashing  a  cyber-attack  that  few — if 
anyone — ever  anticipated. 

I  continued  on  my  personal  Twitter  quest  to  monitor  the  trolls  and 
their  techniques  throughout  the  election.  I  have  seen  several  dark  places 
on  Twitter.  After  clicking  through  several  leads,  I  sometimes  felt  as  if  I 
was  in  a  dark  place  surrounded  by  soulless,  faceless  demi-humans 
spouting  hate  and  lies  robotically.  In  some  cases,  it  was  a  Twitter  “hot.” 

The  topic  of  Russian  interference  in  the  election  is  controversial,  and 
clearly,  it  has  been  framed  as  a  partisan  issue.  I  do  not  believe  that  it 
should  be  a  partisan  issue,  and  this  paper  will  not  fall  on  a  side  of  the 
election.  To  be  certain.  President  Trump’s  campaign  benefited  from  the 
Russian  influence  operation,  but  the  fact  that  the  issue  has  taken  an 
ugly  partisan  slant  on  both  sides  is  exactly  the  goal  of  any  troll, 
particularly  the  Russian  cyber  warriors. 

I  cannot  fully  elaborate  on  all  of  the  psychological,  sociological,  or 
even  technological  details  with  influence.  My  intent  is  to  highlight  how  an 
adversary  uses  social  media  to  manipulate  the  American  public.  Until  the 
public  and  our  leaders  understand  the  true  nature  of  social  media 
manipulation,  Russia  will  likely  continue  to  exploit  that  vulnerability, 
and  other  adversaries  will  attempt  to  use  the  same  methods. 
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ABSTRACT 


This  study  demonstrates  how  social  media  is  a  tool  for  modern 
warfare  in  the  information  age.  The  report  builds  on  analysis  of  three 
distinct  topics:  social  networking,  propaganda,  and  news  and 
information  sharing.  Two  case  studies  are  used  to  show  how  state  and 
non-state  actors  can  use  social  media  to  employ  time-tested  propaganda 
techniques  to  5deld  far-reaching  results.  The  spread  of  the  propaganda 
message  is  accomplished  by  tapping  into  an  existing  narrative,  then 
amplifying  that  message  with  a  network  of  automatic  “hot”  accounts  to 
force  the  social  media  platform  algorithm  to  recognize  that  message  as  a 
trending  topic.  The  first  case  study  analyzes  ISIS  as  the  non-state  actor, 
and  the  second  observes  Russia  as  the  state  actor,  with  each  providing 
evidence  of  successful  weaponizing  of  social  media.  The  paper  concludes 
that  weaponization  of  social  media  will  continue  to  be  a  decisive  factor  in 
future  warfare  as  more  countries  attempt  to  build  influence  operations 
on  social  media  in  the  same  way  Russian  operators  conducted 
information  warfare  against  the  United  States  in  the  2016  Presidential 
Election. 
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Introduction 


The  battlefield  can  no  longer  be  limited;  it  now  extends  to  all 
the  lands  and  seas  of  all  the  nations  in  the  war.  No  longer  can 
a  line  of  demarcation  be  drawn  between  belligerents  and 
nonbelligerents,  because  all  citizens  wherever  they  are  can  be 
victims  of  an  enemy  offensive. 


Giulio  Douhet,  1928 


For  years,  analysts  in  the  defense  and  intelligenee  eommunities 
have  warned  lawmakers  and  the  Ameriean  publie  of  the  risks  of  a  eyber 
Pearl  Harbor.  The  fear  of  a  widespread  eyber-based  attaek  loomed  over 
the  eountry  following  intrusions  against  Yahoo  email  aeeounts  in  2012, 
Sony  Studios  in  2014,  and  even  the  United  States  Government  (USG) 
Offiee  of  Personnel  Management  (OPM)  in  2015.  The  average  Ameriean 
likely  did  not  understand  exaetly  how,  or  for  what  purposes,  US 
adversaries  were  operating  within  the  cyber  domain;  but  the 
consequences  of  future  attacks  were  not  difficult  to  imagine. 

According  to  experts,  enemies  of  the  United  States  could  target 
vulnerable  power  grids,  stock  markets,  train  switches,  academic 
institutions,  banks,  and  communications  systems  in  the  opening  salvos 
of  this  new  type  of  warfare.  ^  But  what  may  have  been  the  most  signifiant 
cyber-attack  on  the  United  States  was  neither  a  brute-force  strike 
typically  associated  with  warfare  nor  a  massive  theft  of  money  or  data.  In 
fact,  hacking  was  only  a  minuscule  part  of  a  cyber  operation  designed  by 
Russian  agents  to  affect  the  United  States  Presidential  election  of  2016.2 


1  Elisabeth  Bumiller,  and  Thom  Shanker.  “Panetta  Warns  of  Dire  Threat  of  Cyberattack 
on  U.S.”  The  New  York  Times.  October  11,  2012. 

2  Office  of  Director  of  National  Intelligence.  Report:  “Assessing  Russian  Activities  and 
Intentions  in  Recent  US  Elections.”  January  6,  2017. 


Instead,  this  operation  was  characterized  by  the  insidious  exploitation  of 
existing  social  media  sites. 

This  paper  analyzes  the  weaponization  of  social  media  by  US 
adversaries,  including  both  state  and  non-state  actors.  Social  media 
sites  like  Twitter  and  Facebook  employ  an  algorithm  to  analyze  words, 
phrases,  or  hashtags  to  create  a  list  of  topics  sorted  in  order  of 
popularity.  For  users,  the  trend  list  is  a  quick  way  to  review  the  most 
discussed  topics  at  a  given  time.  And  according  to  a  201 1  Cornell 
University  study  on  social  media,  a  trending  topic  “will  capture  the 
attention  of  a  large  audience  for  a  short  period.”  The  trend  list  thus 
“contributes  to  agenda  setting  mechanisms. Utilizing  existing  online 
networks  in  conjunction  with  automatic  “hot”  accounts,  foreign  agents 
can  insert  propaganda  into  a  social  media  platform,  create  a  trend,  and 
rapidly  disseminate  the  message  faster  and  cheaper  than  through  any 
other  medium  in  history.  I  argue  that  in  contrast  to  more  traditional 
forms  of  cyber- attack,  US  adversaries  now  seek  to  control  and  exploit  the 
trend  mechanism  on  social  media  to  harm  US  interests,  discredit  public 
and  private  institutions,  and  sow  domestic  strife.  Such  efforts  represent 
a  relatively  novel  and  increasingly  dangerous  means  of  weaponizing 
social  media,  which  I  label  Command  of  the  Trend. 


The  New  Battlefield 

Command  of  the  trend  requires  few  resources  and  minimal 
technical  skill.  Both  state  and  non-state  actors  outside  the  United  States 
can  access  regular  streams  of  online  information  via  social  media  to 
influence  networked  groups  within  the  United  States.  Thus,  instead  of 
attacking  the  military  or  economic  infrastructure,  cyber  operations  now 


3  Sitaram  Asur,  Bernardo  A.  Huberman,  Gabor  Szabo,  and  Chunyan  Wang.  "Trends  in 
Social  Media:  Persistence  and  Decay."  (Cornell  University,  2011),  1. 
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target  the  people  within  a  soeiety,  influeneing  their  beliefs  as  well  as 
behaviors,  and  diminishing  trust  in  the  government  and  publie 
institutions. 

This  eoneept,  at  its  eore,  is  similar  to  a  theory  proposed  by  Italian 
air  power  theorist,  Giulio  Douhet.  In  his  post-World  War  1  book.  The 
Command  of  the  Air,  Douhet  posited  that  air  power  would  fundamentally 
change  warfare  because  of  its  unique  capability  to  bypass  the  bloody 
stalemate  of  land  combat  and  bring  warfare  directly  to  the  enemy  citizen. 
According  to  Thomas  Hippier,  who  analyzed  Douhet’s  theory  in  Bombing 
the  People,  the  most  important  theme  “and  the  one  on  which  Douhet 
insists  on  several  occasions”  is  the  “nationalization  of  war.”^  In  a 
democracy,  the  will  of  the  people  dictates  the  actions  of  the  government. 
Therefore,  the  potential  for  direct  attacks  against  the  population  will  lead 
to  fewer  wars  because,  “people  will  not  be  able  to  say  anymore:  ‘Let  us  all 
arm  for  war,  but  you  go  and  do  the  fighting.  ”’5 

Given  the  destructiveness  assumed  with  industrial- age  air  power 
theory,  it  is  ironic  that  current  expectations  for  air  strikes  involve 
minimal  civilian  casualties.  Because  of  this  sensitivity,  adversaries  like 
al-Qaeda  have  been  quick  to  use  images  of  civilian  casualties — including 
fake  and  misidentified  pictures  of  dead  bodies — as  propaganda  against 
the  United  States.  Images  shared  via  social  media  networks  have  proven 
valuable  for  both  demonstrating  US  incompetence  and  recruiting  new 
fighters.  One  such  recruit  was  Arid  Uka,  an  Albanian  Muslim  living  in 
Germany,  who  killed  two  US  military  members  at  a  Frankfurt  airport  in 
2011  after  watching  highly  edited  YouTube  videos  of  Americans  allegedly 
committing  atrocities  against  Muslim  civilians.^ 


Thomas  Hippier,  Bombing  the  People:  Giulio  Douhet  and  the  Foundations  of  Air-power 
Strategy,  1884-1939.  (Cambridge  Military  Histories,  2013),  85. 

5  Douhet,  196. 

6  Gabriel  Weimann,  Terrorism  in  Cyberspace  :  The  next  Generation.  (Washington,  D.C.: 
Woodrow  Wilson  Center  Press,  2015),  125. 
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Stories  like  that  of  Arid  Uka  are  well  known.  The  “self-radiealized” 
jihadist  spends  time  on  various  soeial  media  networks,  watehing  videos 
and  reading  religious  teaehings,  eventually  eoming  to  a  point  where  he  or 
she  is  willing  to  eommit  a  terrorist  aet.  Perhaps  no  group  has  used 
soeial  media  to  reeruit  as  effeetively  as  the  Islamie  State  of  Iraq  and  Syria 
(ISIS).'^  Using  a  variety  of  platforms,  ISIS  has  shown  that  “soeial  media 
ean  eompensate  for  the  disadvantages  of  undiseiplined  groups  by 
reducing  the  costs  of  coordination. Beyond  recruitment  and 
coordination,  ISIS  has  also  demonstrated  the  viability  of  social  media  as 
a  propaganda-spreading  machine,  which  was  certainly  not  the  original 
purpose  of  networking  websites. 

The  adaptation  of  social  media  as  a  tool  of  modern  warfare  should 
not  be  surprising.  According  to  Douhet,  “technology  must  adapt  itself  to 
the  needs  of  war,  and  not  the  needs  of  technology. Internet  technology 
evolved  to  meet  the  needs  of  information-age  warfare  around  2006  with 
the  dawn  of  Web  2.0,  which  allowed  internet  users  to  create  content 
instead  of  just  consuming  online  material.  The  social  nature  of  man 
ultimately  led  to  virtual  networking.  As  such,  traditional  forms  of  media 
were  bound  to  give  way  to  a  more  tailorable  form  of  communication,  and 
US  adversaries  were  quick  to  find  ways  to  exploit  the  openness  of  the 
internet,  eventually  developing  techniques  to  employ  social  media 
networks  as  a  tool  to  spread  propaganda. 

That  said,  it  is  worth  noting  Eric  Hoffer’s  comments  that 
“propaganda  on  its  own  cannot  force  its  way  into  unwilling  minds, 
neither  can  it  inculcate  something  wholly  new.”io  For  propaganda  to 
function,  it  needs  a  previously-existing  narrative  to  build  upon,  as  well 

The  Islamic  state  is  sometimes  referred  to  as  IS,  ISIS,  ISIL  or  Daesh.  For  simplicity, 
this  paper  will  refer  to  the  group  as  ISIS  unless  a  quote  uses  a  different  term  for  the 
group. 

®  Clay  Shirky,  "The  Political  Power  of  Social  Media."  Foreign  Affairs.  December  20,  2011. 
5  Hippier,  46. 

10  Eric  Hoffer,  The  True  Believer;  Thoughts  on  the  Nature  of  Mass  Movements.  (New  York: 
Harper  and  Row,  1951),  105. 
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Figure  1.  Fake  advertisements  associated  with  a  Twitter  trend 

Source:  Author  created  compilation  of  Twitter  screenshots,  October  2016 
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For  example,  Figure  1  shows  various  images  that  trended  on 
Oetober  28,  2016,  using  the  hashtag  #DraftOurDaughters.  The  basis  of 
the  hashtag  was  an  aetual  news  story  on  Presidential  eandidate  Hillary 
Clinton’s  support  for  ineluding  women  in  Seleetive  Serviee.  A  well- 
ehoreographed  eampaign  took  the  artiele  and  added  a  realistie-looking 
eampaign  advertisement  using  graphies  and  font  assoeiated  with  the 
Clinton  eampaign.  The  pietures  on  those  fake  advertisements  used  stoek 
images  available  for  free  using  a  Google  Image  search.  The  accounts 
sending  out  those  images  attached  the  hashtag  using  two  different 
approaches:  acting  as  supporters  of  Clinton  who  wanted  to  draft  women 
to  “go  to  war  with  Russia,”  and  posing  as  people  opposed  to  Clinton  and 
her  purported  plans.  Sometimes  a  single  account  would  send  tweets 
acting  as  both  a  supporter  and  opponent,  with  each  tweet  emplo5dng  the 
same  hashtag  in  order  to  induce  a  trend.  Additionally,  some  of  the  tweets 
included  other  trending  topics  to  maximize  viewing  across  several  trends. 
The  images  inspired  a  variety  of  interactions  based  on  the  political 
leanings  of  the  viewer,  but  each  discussion  kept  the  trend  going. 
Ultimately,  the  trend  spread  to  a  worldwide  audience  even  though  the 
underl5dng  message  was  fake.  Based  on  an  identifiable  pattern,  it 
appears  an  army  of  Russian  “trolls”  and  hot  accounts  worked  in  concert 
with  a  network  of  Americans  to  spread  the  disinformation. 

Command  of  the  trend  hinges  on  four  factors: 

1.  A  message  that  fits  an  existing,  even  if  obscure,  narrative 

2.  A  group  of  “true  believers”  predisposed  to  the  message 

3.  A  relatively  small  team  of  agents  or  cyber  warriors 

4.  A  network  of  automated  “hot”  accounts 

The  existing  narrative  and  the  true  believers  who  subscribe  to  it  are 
endogenous,  so  any  propaganda  must  fit  that  narrative  to  penetrate  the 
network  of  true  believers.  Usually,  the  cyber  team  is  responsible  for 
crafting  the  specific  message  for  dissemination.  The  cyber  team  then 
generates  videos,  memes,  or  fake  news,  often  in  collusion  with  the  true 
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believers.  To  aehieve  the  effeetive  spread  of  propaganda,  the  true 
believers,  the  eyber  team,  and  the  bot  network  eombine  efforts  to  take 
eommand  of  the  trend.  Going  forward,  this  paper  will  explore  the  four 
faetors  assoeiated  with  eommand  of  the  trend,  faetors  whieh  together 
faeilitate  the  weaponization  of  soeial  media. 


Structure 

Again,  1  argue  that  foreign  aetors  now  seek  to  eontrol  and  exploit 
the  trend  meehanism  of  soeial  media  to  harm  US  interests  and  sow 
domestie  strife.  In  support  of  this  elaim,  the  remainder  of  the  paper  is 
divided  into  four  ehapters.  Chapter  1  provides  a  basis  for  understanding 
the  weaponization  of  soeial  media  via  eommand  of  the  trend.  It  begins 
with  definitions  of  soeial  media  and  an  analysis  of  soeial  media  as  a  tool 
for  both  obtaining  and  spreading  information.  It  then  looks  more 
speeifieally  at  how  US  adversaries  ean  utilize  soeial  media  to  target  US 
citizens  with  malicious  propaganda. 

The  next  two  chapters  provide  evidence  of  how  non- state  and  state 
actors  alike  weaponize  social  media  to  counter  the  United  States.  The 
first  case  study  covers  ISIS  from  2014-2016  to  include  an  examination  of 
the  group’s  use  of  social  media  for  recruiting,  spreading  propaganda,  and 
proliferating  terror  threats.  Chapter  3,  the  second  case  study,  describes 
Russian  hacking,  espionage,  disinformation,  and  manipulation  of  social 
media  as  related  to  the  United  States  election  of  2016.  Evidence  for  this 
second  case  study  comes  from  nearly  two  years  of  watching  the  activity 
of  Twitter  accounts  believed  by  the  author  to  be  part  of  a  Russian 
information  warfare  network. 

Douhet  concluded  The  Command  of  the  Air  with  a  fictional  account 
of  his  prediction  for  the  next  war.  Similarly,  Chapter  4  of  this  study 
provides  analysis  and  predictions  of  how  the  weaponization  of  social 
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media  will  continue  to  develop  and  what  it  will  look  like  in  the  future. 
The  paper  concludes  with  a  discussion  of  how  the  United  States  can 
respond  to  the  growing  threat  of  adversaries  who  seek  to  harm  US 
interests  and  foster  domestic  instability  through  command  of  the  trend. 


8 


Chapter  1 


From  a  Place  for  Friends  to  the  Nexus  of  Cyber  Warfare 


Young  people  don't  want  to  rely  on  a  God-like  figure  from 
above  to  tell  them  what's  important.  And  to  carry  the  religion 
analogy  a  bit  further,  they  certainly  don't  want  news 
presented  as  gospel.  Instead,  they  want  their  news  on 
demand,  when  it  works  for  them.  They  want  control  over  their 
media,  instead  of  being  controlled  by  it.  They  want  to 
question,  to  probe,  to  offer  a  different  angle. 


Rupert  Murdoch,  2005 


In  2006,  Time  named  “You”  the  person  of  the  year  because  the 
increase  in  user-based  internet  content  such  as  social  media,  online 
video  sharing,  and  wikis  made  the  internet  “a  tool  for  bringing  together 
the  small  contributions  of  millions  of  people  and  making  them  matter. 
The  internet  had  evolved  from  a  point  when  a  user  could  only  receive 
information,  to  the  point  where  the  average  user  could  create  new 
content.  Once  this  happened,  networks  of  people  began  to  form  online. 
The  human  desire  to  be  a  part  of  a  crowd  began  to  manifest  itself 
virtually  with  the  coming  of  “Web  2.0.” 

Long  before  the  internet,  German  Nobel  Prize  Laureate  Elias 
Canetti  described  the  power  of  the  crowd  as  being  a  shelter  from  danger 
and  an  escape  from  loneliness.  Canetti  believed  that  “nationalism, 
extremism,  the  yearning  for  democracy  are  all  the  products  of  crowd 
formations  and  thus  manifestations  of  seeking  to  escape  from 


^  Lev  Grossman,  “You  —  Yes,  You  —  Are  TIME'S  Person  of  the  Year.”  Time  Magazine, 
December  25,  2006. 
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loneliness. ”2  Moreover,  aeeording  to  Kaplan,  in  modern  times  the  need  to 
be  part  of  a  erowd  is  “alleviated  by  Twitter  and  Faeebook,  [whieh] 
ultimately  leads  to  the  breakdown  of  traditional  authority  and  the 
ereetion  of  new  kinds. 

Media  mogul  Rupert  Murdoeh  reeognized  the  signifieanee  of  the 
way  people  reeeived  their  information  when  he  purehased  the  MySpaee 
soeial  networking  website  in  2005.  He  noted  that  people  no  longer  had  to 
wait  for  information  or  even  to  have  information  delivered  to  them. 
Instead,  the  individual  could  decide  what  was  important  and  only  read 
what  was  important  on  demand.  Not  only  could  users  select  what  news 
they  want  to  see,  but  they  could  also  use  the  medium  to  create  news 
based  on  their  opinions. ^ 

This  chapter  covers  the  evolution  of  social  media  from  “a  place  for 
friends,”  as  the  MySpaee  motto  proclaimed,  to  a  place  to  spread  ideas 
and  information.  As  such,  social  media  creates  a  point  of  injection  for 
propaganda  and  has  become  the  nexus  of  information  operations  and 
cyber  warfare.  Going  forward,  we  examine  social  media  terms  and 
definitions,  including  the  important  concept  of  the  social  media  trend, 
and  look  briefly  into  the  fundamentals  of  propaganda.  This  chapter 
concludes  by  examining  the  spread  of  news  on  social  media,  specifically, 
the  spread  of  “fake  news”  and  the  penetration  of  propaganda  into 
mainstream  media  outlets. 


Social  Networks  and  Social  Media 


2  Robert  D.  Kaplan,  Revenge  of  Geography.  Random  House.  Kindle  ebook.  2012:  2,140 

3  Kaplan,  2,140 

Jeremy  Scott- Joynt,  “What  Myspace  means  to  Murdoch.”  BBC  News  Analysis. 
http://news.bbc.co.Uk/2/hi/business/4697671.stm.  July  19,  2005. 
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As  social  media  usage  beeame  more  widespread,  users  beeame 
enseoneed  within  speeifie,  self-seleeted  groups,  whieh  meant  that  news 
and  views  were  shared  nearly  exelusively  with  like-minded  users.  In 
network  terminology,  this  group  phenomenon  is  ealled  homophily.  More 
eolloquially,  it  refleets  the  eoneept  that  “birds  of  a  feather  floek  together.” 
Homophily  within  soeial  media  ereates  an  aura  of  expertise  and 
trustworthiness  where  those  faetors  would  not  normally  exist.  Ultimately, 
this  “echo  chamber”  can  promote  the  scenario  in  which  your  friend  is 
“just  as  much  a  source  of  insightful  analysis  on  the 
nuances  of  U.S.  foreign  policy  towards  Iran  as  regional  scholars,  arms 
control  experts,  or  journalists  covering  the  State  Department. ”5 

Homophily  is  nothing  new.  Politics,  religion,  and  cars,  as  the  old 
sa5dng  goes,  have  always  been  off-limit  topics  for  polite  conversation 
amongst  strangers.  This  sound  advice  is  based  on  the  principle  that  such 
topics  engender  deeply-rooted  beliefs  with  strong  ties  to  emotions,  and 
people  have  always  tended  to  bond  with  those  who  think  alike  while 
rejecting  the  ideas  of  those  they  do  not — especially  with  regards  to 
politics.  During  the  2008  Presidential  election,  Valdis  Krebs’  consulting 
firm  reviewed  data  from  Amazon  book  sales.  The  results  (see  Figure  2) 
indicate  that  people  only  bought  Republican-leaning  or  Democrat-leaning 
books — there  was  no  overlap  in  book  sales. ^ 


5  Tom  Hashemi,  “The  Business  of  Ideas  is  in  trouble:  Re-injecting  Facts  Into  a  Post¬ 
truth  World.”  War  on  the  Rocks.  December  9,  2016. 

6  Charles  Kadushin,  Understanding  social  networks:  Theories,  concepts,  and  findings. 
(New  York:  Oxford  University  Press,  2012),  7. 
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Figure  2.  Books  bought  by  the  same  people  during  2008  election. 

Source:  Understanding  Social  Networks,  Kadushin 


The  clusters  of  book  sales  represent  networks.  Social  media  allows 
the  people  who  make  up  those  networks  to  reach  out  and  discuss  politics 
with  each  other.  Again,  this  concept  is  not  new.  At  nearly  any  diner  in 
America,  you  can  find  a  group  of  people  sitting  together  discussing 
politics;  but  social  media  gives  users  the  chance  to  forge  a  network  larger 
than  their  local  coffee  shop.  Unlike  with  the  local  network,  social  media 
users  can  simply  ignore  or  “unfollow”  opinions  that  do  not  match  their 
own.  Online  networking  allows  people  to  find  comfort  in  the  crowd  in  the 
same  way  humans  always  have,  but  now  on  a  much  larger  scale,  with 
faster  access  to  information. 

Michigan  State  professor  Anthony  Olcott  describes  the  wealth  of 
information  available  on  the  internet  as  the  “third  information 
revolution,”  following  the  creation  of  writing  and  the  invention  of  the 
printing  press.  Humans  have  always  adapted  to  having  access  to  more 
information,  and,  according  to  Olcott,  homophily  is  just  one  method  of 
countering  the  “indigestibility”  of  the  large  volume  of  information 
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available  on  the  internet.'^  The  problem  of  volume  is  just  one  of  the 
ehallenges  he  ealls  the  “The  Six  Vs”  (Table  1). 


Table  1.  Challenge  of  the  Six  Vs 


Volume 

Massive  amounts  of  information  now  produced 

and  available  on  the  internet. 

Velocity 

Information  available  in  near  real-time 

Vector 

Information  no  longer  flows  “downward,  from 

authorities  and  elites  to  masses.” 

Veracity 

Information  may  or  may  not  be  accurate 

Verifiability 

Source  of  information  is  difficult  to  prove 

Vulgarity 

From  the  Latin  word  “Vulgar,”  meaning  from 

ordinary  people. 

Source:  Institutions  and  Information:  The  Challenge  of  the  Six  Vs,  Olcott 


Each  of  Olcott' s  “Vs”  challenge  governments  and  institutions,  even 
without  the  introduction  of  propaganda.  On  the  other  hand,  the 
challenges  presented  to  institutions  by  the  Six  Vs  are  likely  beneficial  for 
those  who  seek  to  exploit  social  media  for  propaganda  because  people 
online  are  already  in  a  position  to  believe  the  same  thing  as  the  rest  of 
their  network;  one  is  less  likely  to  question  information  when  it  is  already 
accepted  by  like-minded  associates. 

If  social  media  facilitates  self-reinforicng  networks  of  like-minded 
users,  how  can  a  propaganda  message  transverse  across  networks? 
Consider  the  two  networks  in  Figure  1.  There  are  no  overlapping  nodes. 
While  that  may  be  the  case  with  political  beliefs,  there  may  be  connectors 


Anthony  Olcott,  “Institutions  and  Information:  The  Challenge  of  the  Six  Vs.”  ISD 
Working  Paper  in  New  Diplomacy.  Institute  for  the  Study  of  Diplomacy,  Georgetown 
University,  2010. 
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on  social  media  that  fall  within  someone's  interests,  but  outside  of  his  or 
her  politieal  network.  For  example,  a  person  may  be  a  stauneh 
Republiean,  but  have  soeial  media  eonneetions  with  equally  stauneh 
Demoerats  beeause  of  their  mutual  interests  in  the  same  sports  team. 

However,  this  link  between  networks  is  only  based  on  that  single 
topie  and  ean  be  easily  severed.  When  it  eomes  to  polities  in  partieular, 
people  will  sometimes  not  only  rejeet  the  message  eoming  from  a 
particular  user  but  will  also  reject  that  person  as  well.  This  dismissal  on 
social  media  results  in  an  “unfriending,”  or  unfollowing  of  that  user 
despite  the  connection  made  at  some  other  level — just  ask  any  social 
media  users  who  cut  ties  with  family  members  on  social  media  during 
the  2016  election. 

So,  a  loose  and  easily  breakable  connection  is  unlikely  to  impact 
large  swaths  of  the  population,  which  means  that  a  “structural  hole” 
exists  between  networks  impeding  flows  of  information  between  two 
opposing  clusters  of  homophilic  viewpoints. ^  Thus,  to  effectively  employ 
social  media  to  as  a  tool  of  propaganda,  an  adversary  cannot  rely  on 
individual  weak  links  between  networks.  Instead,  an  adversary  can 
exploit  a  feature  within  the  social  media  platform  that  enables  cross¬ 
network  data  sharing  on  a  massive  scale:  the  trending  topics  list. 

Trending  topics  are  available  on  several  different  social  media 
platforms,  ineluding  the  two  most  popular  in  the  United  States:  Faeebook 
and  Twitter.  Trends  are  visible  to  everyone.  Regardless  of  who  follows 
whom  on  a  given  soeial  media  platform,  all  users  see  the  topies 
algorithmieally  generated  by  the  platform  as  being  the  most  popular 
topies  at  that  partieular  moment.  Given  this  universal  and  unavoidable 
visibility,  “popular  topies  eontribute  to  the  eolleetive  awareness  of  what  is 
trending  and  at  times  ean  also  affeet  the  publie  agenda  of  the 


8  Kadusin,  30. 
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community.”^  In  this  manner,  a  trending  topie  ean  bridge  the  gap 
between  elusters  of  soeial  networks.  And  further,  a  malieious  aetor  ean 
quiekly  spread  propaganda  by  injeeting  a  narrative  onto  the  trend  list. 


Social  Media  Terminology 

Before  diseussing  propaganda  in  more  depth,  it  is  worthwhile  to 
elarify  some  key  eoneepts  assoeiated  with  soeial  media.  To  start,  we 
have  the  trend.  As  deseribed  above,  a  trending  topie  transeends  networks 
and  beeomes  the  meehanism  for  the  spread  of  information  aeross  soeial 
elusters.  Several  soeial  media  platforms  provide  a  trends  list.  This  paper 
foeuses  primarily  on  Twitter,  a  “mieroblogging”  site  where  eaeh  post, 
ealled  a  “tweet,”  is  limited  to  140  eharaeters.^®  Faeebook  also  has  a 
trends  list,  but  it  is  less  visible  than  the  Twitter  trends  list;  and  the  two 
applieations  serve  different  purposes. 

Faeebook  dethroned  MySpaee  as  the  most  popular  soeial  media 
site  around  2009,  but  it  still  maintains  a  similar  function  as  MySpaee, 
that  of  bringing  friends  and  families  together.  Faeebook,  along  with 
applications  like  Instagram  and  Snapchat,  are  like  modern  day 
postcards;  you  can  share  what  you  are  doing  and  how  you  are  feeling 
with  an  audience  of  followers.  On  Faeebook,  your  connections  are 
typically  more  intimate  connections  than  you  would  expect  on  Twitter, 
which  focuses  less  on  bringing  people  together  and  more  on  bringing 
ideas  together. 

As  a  microblog,  the  core  notion  behind  Twitter  is  to  share  your 
thoughts  and  feelings  about  the  world  around  you  with  a  group  of  people 
who  share  similar  interests.  The  individuals  who  follow  each  other  may 


9  Sitaram  Asur,  Bernardo  A.  Huberman,  Gabor  Szabo,  and  Chunyan  Wang.  "Trends  in 
Social  Media:  Persistence  and  Decay."  (Cornell  University,  2011),  1. 

10  “Blog”  is  short  for  “web  log.”  A  blog  is  a  way  to  share  your  thoughts  via  the  internet.  A 
microblog  is  a  blog  with  a  character  limit  to  the  text. 
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not  be  friends  but  eould  be  a  team  of  like-minded  aeademies,  journalists, 
sports  fans,  or  politieos.  When  a  person  tweets,  that  tweet  ean  be  viewed 
by  anyone  who  follows  that  person,  or  anyone  who  searehes  for  that  topie 
using  Twitter’s  seareh  tool.  Additionally,  anyone  ean  “retweet”  someone 
else’s  tweet,  whieh  broadeasts  the  original  tweet  to  a  new  audienee. 
Twitter  makes  real-time  idea  and  event  sharing  possible  on  a  global 
seale.ii 

For  example,  someone  who  is  interested  in  what  people  are  talking 
about  on  Twitter  regarding  Tom  Brady  can  do  a  search  within  the 
application  to  discover  what  the  average  person  thinks,  as  well  as  what 
sports  experts  are  sa5dng  about  Brady.  If  one  searches  for  discussion  on 
Tom  Brady  during  the  Super  Bowl,  the  user  doing  the  search  will  receive 
much  more  information  than  if  he  were  to  do  a  search  during  the  off¬ 
season.  In  fact,  one  would  expect  that  if  Tom  Brady  is  in  the  Super  Bowl, 
his  name  would  probably  be  trending  during  the  game  as  the  total  tweets 
mentioning  his  name  would  cross  the  trend  threshold  for  everyone  to  see 
on  Twitter — even  those  who  are  not  watching  the  Super  Bowl  or  have  no 
interest  in  Tom  Brady. 

Another  method  for  quick  referencing  on  Twitter  is  by  using  a 
“hashtag.”  A  hashtag  uses  the  symbol  ‘#’  to  create  a  clickable  link  for  the 
word  that  follows.  Using  the  example  above,  a  Twitter  user  could  post  a 
thought  on  the  game,  perhaps,  “Nice  pass,  Brady,”  and  include  the 
hashtag  #SuperBowl  within  the  tweet.  The  tweet  would  then  be  visible  to 
anyone  who  clicked  on  the  link  #SuperBowl,  along  with  all  of  the  other 
tweets  using  the  same  hashtag. 

Because  Twitter  is  an  idea-sharing  platform,  it  is  very  popular  for 
rapidly  spreading  information,  especially  amongst  journalists  and 
academics;  however,  malicious  users  have  also  taken  to  Twitter  for  the 


Rani  Molla,  “Social  Studies:  Twitter  vs.  Facebook.”  Bloomberg  Gadfly.  February  12, 
2016. 
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same  benefits  in  reeent  years.  At  one  time,  groups  like  Al-Qaida  preferred 
ereating  websites,  but  now,  “Twitter  has  emerged  as  the  internet 
applieation  most  preferred  by  terrorists,  even  more  popular  than  self- 
designed  websites  or  Faeebook.”i2  Twitter  makes  it  easy  to  spread  a 
message  to  both  supporters  and  foes  outside  of  a  partieular  network. 
Groups  trying  to  disseminate  a  message  as  widely  as  possible  ean  rely  on 
the  trend  funetion  to  reaeh  aeross  multiple  networks. 

There  are  three  methods  for  controlling  what  is  trending  on  social 
media:  trend  distribution,  trend  hijacking,  and  trend  creation.  The  first 
method,  trend  distribution  is  relatively  easy  and  requires  the  least 
amount  of  resources.  Trend  distribution  is  simply  appl5dng  a  message  to 
every  trending  topic.  Using  the  example  above,  someone  could  tweet  a 
picture  of  the  president  with  a  message  in  the  form  of  a  meme — a  stylistic 
device  that  applies  culturally  relevant  humor  to  a  photo  or  video — along 
with  the  unrelated  hashtags  #Brady  and  #SuperBowl.  Anyone  who  clicks 
on  those  trends  on  the  trend  list  expecting  to  see  something  about 
football  will  see  that  meme  of  the  president.  The  other  two  methods  of 
commanding  the  trend,  trend  hijacking  and  trend  creation,  require  more 
resources  in  the  form  of  either  more  followers  spreading  the  message  or  a 
network  of  “bots”  designed  to  spread  the  message  automatically. 


Bot  Networks 

Again,  there  are  three  methods  of  gaining  command  of  the  trend: 
trend  distribution,  trend  hijacking,  and  trend  creation.  The  latter,  trend 
creation,  requires  the  most  effort.  It  necessitates  money  to  promote  a 
trend,  knowledge  of  the  social  media  environment,  and  a  network  of 
several  automatic  “bot”  accounts. 


12  Weimann,  138. 
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Bot  accounts  are  non-human  accounts  that  automatically  tweet 
and  retweet  based  on  a  set  of  programmed  rules.  In  2014,  Twitter 
estimated  that  only  5  pereent  of  aeeounts  were  hots;  that  number  has 
grown  along  with  the  total  users,  and  now  tops  15  pereent.  Some  of  the 
aeeounts  are  “news  hots,”  whieh  just  retweet  the  trending  topies.  Some  of 
the  aeeounts  are  for  advertising  purposes,  whieh  try  to  dominate 
eonversations  to  generate  revenue  through  elieks  on  links.  Some  hots  are 
trolls,  which,  like  a  human  version  of  an  online  troll,  tweet  to  disrupt  the 
civil  conversation. 

Of  course,  many  groups  -  not  just  with  malicious  intent  —  can 
benefit  from  trending  topics  on  social  media.  Advertising  firms  routinely 
purchase  trending  topics,  which  Twitter  marks  with  a  “Promoted”  tag. 

For  seamless  advertising,  a  company  prefers  “product  placement” 
messages,  which  are  similar  in  nature  to  a  product  placement  in  a 
television  show.  The  social  media  equivalent  is  called  viral  marketing, 
which  employs  seemingly  non-affiliated  social  media  accounts  that  tweet 
positive  remarks  about  a  particular  brand. 

Vice  News  Tonight  recently  traveled  to  a  marketing  firm  in  London 
to  cover  a  group  of  employees  whose  only  discernable  job  skills  were 
being  young  and  understanding  the  social  media  environment.  Those 
employees  used  their  personal  Twitter  accounts  to  launch  nation-wide 
advertising  eampaigns.  During  the  interview,  the  marketing  team  deeided 
to  start  a  hashtag  to  promote  a  produet.  Within  four  minutes,  their 
hashtag  was  trending  aeross  the  whole  of  the  UK.^^ 

For  malieious  aetors  seeking  to  influenee  a  population  through 
trends  on  soeial  media,  the  best  way  to  establish  trends  is  to  build  a 

13  Alex  Lubben,  "Twitter’s  users  are  15  percent  robot,  but  that’s  not  necessarily  a  bad 
thing."  VICE  News.  Mar  12,  2017. 

14  According  to  Jacques  Ellul,  advertising  is  the  most  effective  form  of  propaganda 
because  it  places  a  message  in  the  context  of  daily  life. 

13  Kadushin,  10. 

13  Hind  Hassan,  “For  millennials,  by  millennials:  Startup  Social  Chain  is  taking  social- 
media  marketing  to  a  new  level.”  Vice.com,  February  26,  2015. 
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network.  The  easiest  way  to  build  a  network  is  to  ereate  hot  aeeounts 
programmed  to  tweet  at  various  intervals,  respond  to  eertain  words,  or 
retweet  when  direeted  by  a  master  aeeount.  Figure  3  illustrates  the 
basies  of  a  hot  network.  The  top  of  the  ehain  is  a  small  eore  group.  That 
team  is  eomprised  of  human-eontrolled  aeeounts  with  a  large  number  of 
followers.  The  aeeounts  are  typieally  adversary  eyber  warriors  or  true 
believers  with  a  large  following.  Under  the  eore  group  is  the  hot  network. 
Bots  tend  to  follow  each  other  and  the  core  group.  Below  the  hot  network 
is  a  group  consisting  of  the  true  believers  without  a  large  following.  These 
human-controlled  accounts  are  a  part  of  the  network,  but  they  appear  to 
be  outsiders  because  of  the  weaker  links  between  the  accounts.  The 
bottom  group  lacks  a  large  following,  but  they  do  follow  the  core  group, 
sometimes  follow  hot  accounts,  and  seldom  follow  each  other. 

Enough  bots  working  together  can  quickly  start  a  trend  or  take 
over  a  trend,  but  hot  accounts  themselves  can  only  bridge  the  structural 
hole  between  networks,  not  completely  change  a  narrative.  To  change  a 
narrative,  to  conduct  an  effective  influence  operation,  requires  that  a 
group  combine  a  well-coordinated  hot  campaign  with  essential  elements 
of  propaganda. 
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Figure  3.  Illustration  of  a  bot  network 

Source:  Author 


Propaganda  Primer 

Messaging  designed  to  influence  behavior  has  been  around  for 
centuries  but  became  easier  as  methods  of  mass  communication  enabled 
wider  dissemination  of  propaganda.  During  World  War  II,  public  service 
announcements  (PSA)  over  the  radio  and  on  artistic  posters  connected  a 
United  States  Government  (USG)  message  directly  to  the  American 
public.  This  form  of  propaganda  helped  recruiting,  instilled  patriotism, 
and  encouraged  behavior  such  as  investing  in  war  bonds  or  living  within 
the  limits  of  rationing.  There  are  two  kinds  of  propaganda  employed  by 
governments:  propaganda  to  promote  conformity  amongst  a  domestic 
audience  and  information  warfare  designed  to  target  a  foreign  audience. 
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The  Cold  War  was  somewhat  of  a  high  point  for  the  research  of 
propaganda  because,  according  to  a  United  States  Information  Agency 
(USIA)  official  in  the  early  1960s,  “unless  there  is  a  suicidal  nuclear  war, 
the  balance  of  power  between  ourselves  [sic]  and  the  communists  will 
largely  be  influenced  by  public  opinion. The  United  States  and  the 
Soviet  Union  both  took  advantage  of  mass  communications  enabling  the 
rapid  spread  of  information  as  more  people  around  the  world  started 
receiving  news  and  information  via  television. 

Observing  the  rise  of  mass  media  and  its  presence  in  daily  life, 
French  philosopher  Jacques  Ellul  noted  the  simplicity  of  propaganda  in 
1965.  According  to  Ellul,  “Propaganda  ceases  where  simple  dialogue 
begins. Essentially,  propaganda  permeates  everyday  experiences,  and 
the  individual  targeted  with  a  massive  media  blitz  will  never  fully 
understand  that  the  ideas  he  has  are  not  entirely  his  own,  just  as 
researchers  cannot  fully  determine  the  effectiveness  of  propaganda. 

Ellul  also  describes  shared  emotions  within  propaganda  in  the 
same  way  advertisers  target  mass-marketing  campaigns:  effective 
messaging  targets  an  individual  by  providing  a  message  to  the  masses, 
from  which  an  individual  could  subsequently  infer  the  masses  all  agree 
with  the  message. 20  This  feeling  of  comradery  provides  legitimacy  to  both 
the  emotion  experienced  and  the  message  that  brought  about  the 
particular  feeling.  A  modern  example  of  this  phenomenon  was  observable 
during  the  Arab  Spring  as  propaganda  spread  on  Facebook  “helped 


Phillip  M.  Taylor,  Munitions  of  the  Mind:  A  History  of  Propaganda.  (Manchester 
University  Press,  1995),  265. 

Jacques  Ellul,  Propaganda:  The  Formation  of  Men's  Attitudes.  (New  York:  Knopf, 
1965),  6. 

19  Ellul,  1 1 

20  Ellul,  91. 
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middle-class  Egyptians  understand  that  they  were  not  alone  in  their 
frustration.  ”21 

In  short,  existing  emotions  and  beliefs  are  easier  to  exploit  than 
beliefs  that  fall  outside  of  an  individual’s  social  norms.  Additionally, 
propaganda  is  simpler  to  grasp  if  everyone  around  a  person  seems  to 
share  the  same  emotions  on  a  particular  subject.  Even  a  general 
discussion  amongst  the  crowd  can  provide  the  illusion  that  propaganda 
is  information. 22  In  other  words,  propaganda  creates  heuristics,  which  is 
a  way  that  the  mind  simplifies  problem-solving  by  rel5dng  on  quickly 
accessible  data.  Daniel  Kahneman  addresses  the  topic  of  heuristics  and 
biases  in  his  book.  Thinking,  Fast  and  Slow.  One  of  the  biases  Kahneman 
describes  is  the  concept  that  “what  you  see  is  all  there  is,”  or  WYSIATI, 
for  short.  WYSIATI  facilitates  the  achievement  of  coherence  and  cognitive 
ease  that  causes  us  to  accept  a  statement  as  true. 23  Ingesting 
propaganda  repeatedly  is  likely  to  make  a  person  believe  that  WYSIATI. 

Along  with  WYSIATI,  Kahneman  also  addresses  the  recency  bias  or 
the  “availability  heuristic.”  Like  WYSIATI,  the  availability  heuristic  weighs 
the  amount  and  frequency  of  information  received,  as  well  as  the  recency 
of  the  information  as  more  informative  factors  than  the  source  or 
accuracy  of  the  information.  Essentially,  the  mind  creates  a  shortcut 
based  on  the  most — or  most  recent — information  available,  simply 
because  it  can  be  remembered  easily.  Often,  the  availability  heuristic 
manifests  itself  in  information  received  through  media  coverage. 
Understanding  WYSIATI  and  the  availability  heuristic  is  important  to 
understanding  individual  opinion  formation  (Figure  4),  and  how 
propaganda  can  exploit  the  shortcuts  our  minds  make  to  form  opinions. 


21  Thomas  Rid,  Cyber  War  Will  Not  Take  Place.  (New  York:  Oxford  University  Press, 
2013),  132. 

22  Ellul,  85. 

23  Daniel  Kahneman,  Thinking,  Fast  and  Slow.  (New  York:  Farrar,  Straus  and  Giroux, 
2011),  87. 
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The  lines  in  Figure  3  show  formation  of  opinions  temporally,  with 
double  arrows  influencing  a  final  opinion  more  than  single  arrows.  The 
containers  with  red  circles  indicate  a  penetration  point  for  propaganda 
exploitation.  As  previously  described,  mass  media  enables  rapid  spread 
of  propaganda,  which,  in  turn,  feeds  WYSIATI  and  the  availability 
heuristic.  The  internet  makes  it  possible  to  flood  the  average  person’s 
daily  intake  of  information,  which  aids  the  spread  of  propaganda. 


Figure  4.  Model  of  individual  opinion  formation 

Source:  Public  Opinion  in  America,  Monroe,  p.  147 


Slobodan  Milosevic  of  Serbia  was  the  first  leader  to  make  use  of  the 
internet  combined  with  traditional  media  to  spread  the  propaganda  of  his 
nationalist  message.  Milosevic  created  a  false  story  consisting  of  a 
modicum  of  historical  truth  in  an  attempt  to  re-write  the  history  of 
Kosovo.  Once  he  inserted  his  message  into  state-run  media,  it  constantly 
circulated  on  radio,  television,  and  via  a  newly  established  small  e-mail 
network.  Serbs  slowly  began  to  believe  the  propaganda  because  the  new 
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history  seemed  similar  enough  to  prior  rumors  to  be  believable. 
Additionally,  it  appeared  that  others  shared  the  same  emotions;  and  the 
repetition  of  the  message  ereated  an  availability  heuristie  for  ethnie 
Serbs.  The  result  was  a  human  rights  eatastrophe  as  soldiers  overeame 
“psyehosoeial  dissonanee  ereated  by  this  virtual  reality”  to  eommit 
genoeide  against  their  fellow  eitizens  as  they  believed  they  were  “saving 
Europe,  even  if  Europe  does  not  appreeiate  [their]  efforts. ”24 

Before  the  internet,  technical  limitations  and  high  costs  meant  that 
governments  once  controlled  most  of  the  information  that  the  public 
received. 25  In  the  case  of  Kosovo,  the  government  used  electronic  media 
and  traditional  media  to  change  the  thoughts  and  opinions  of  the 
masses.  Now,  anyone  with  enough  followers  or  hot  accounts  can 
disseminate  a  message  to  a  broad  audience  via  command  of  the  trend. 

Command  of  the  trend  enables  the  contemporary  propaganda 
model,  a  “firehose  of  information”  that  permits  the  insertion  of  false 
narratives  over  time. 26  Because  untruths  can  spread  so  quickly  now,  the 
internet  has  created  “both  deliberate  and  unwitting  propaganda”  since 
the  early  1990s  through  the  proliferation  of  rumors  passed  as  legitimate 
news. 27  The  normalization  of  these  types  of  rumors  over  time,  combined 
with  the  rapidity  and  volume  of  new  false  narratives  over  social  media, 
opened  the  door  for  “fake  news.”  It  is  also  worth  noting  that  the  rise  of 
social  media  came  along  with  increases  in  computing  power  and  mobile 
technology.  In  the  early  days  of  the  internet,  few  people  had  an  expensive 
computer  with  dial-up  internet  access  in  their  homes.  Now,  most  people 
have  high-speed  internet  available  on  their  mobile  phones.  As  such,  a 
firehose  of  false  information  is  available  at  all  times. 

24  Mary  Kaldor,  New  and  Old  Wars:  Organized  Violence  in  a  Global  Era.  (Stanford,  Calif.: 
Stanford  University  Press,  1999),  41. 

25  Olcott,  1. 

25  Christopher  Paul  and  Miriam  Matthews,  “The  Russian  “Firehose  of  Falsehood” 
Propaganda  Model:  Why  It  Might  Work  and  Options  to  Counter  It.”  (Santa  Monica,  CA: 
RAND  Corporation,  2016),  4. 

27  Jowett  and  O’Donnell,  159. 
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The  availability  heuristic  and  the  firehose  of  disinformation  can 
slowly  alter  opinions  as  propaganda  crosses  networks  by  way  of  the 
trend,  but  the  amount  of  influence  will  likely  be  minimal  unless  it  comes 
from  a  source  that  a  non-believer  finds  trustworthy.  An  individual  may 
see  the  propaganda  and  believe  the  message  is  popular  because  it  is 
trending,  but  still  not  buy  into  the  message  itself.  Instead,  the  individual 
will  likely  turn  to  a  trusted  source  of  news  to  test  the  validity  of  the 
propaganda.  Therefore,  we  must  now  analyze  modern  journalism  to 
determine  how  command  of  the  trend  can  transform  propaganda  from 
fake  news  to  real  news. 


Modern  Journalism 

Social  media  has  changed  the  news  landscape  exactly  as  Rupert 
Murdoch  predicted.  The  evidence  of  online  journalism  is  on  display  at 
The  Newseum  in  Washington  DC,  where  tourists  gather  outside  every 
day  to  observe  the  front  pages  of  newspapers  from  every  state 
prominently  on  display  in  front  of  the  building.  The  papers  seem  like 
relics  of  days  gone  by,  as  people  snap  photos  of  the  case  of  newspapers 
using  the  device  by  which  more  and  more  Americans  receive  their  news: 
the  mobile  phone. 

Currently,  72%  of  Americans  get  digital  news  primarily  from  a 
mobile  device,  and  people  now  prefer  online  news  sources  to  print 
sources  by  a  ratio  of  2: The  news  consumer  now  selects  from  an 
abundance  of  options  besides  a  local  newspaper,  based  on  how  the 
consumer  perceives  the  credibility  of  the  resource.  Along  the  lines  of 
social  networking  and  propaganda,  people  are  more  willing  to  believe 
things  that  fit  into  their  worldview.  Once  source  credibility  is  established. 


28  Katerina  Eva  Matsa  and  Kristine  Lu.  “10  facts  about  the  changing  digital  news 
landscape.”  Pew  Research  Center.  September  14,  2016. 


25 


there  is  a  tendeney  to  aeeept  that  souree  as  an  expert  on  other  issues  as 
well,  even  if  the  issue  is  unrelated  to  the  area  of  originally  pereeived 

expertise.  29 

The  eombination  of  networking  on  soeial  media,  propaganda,  and 
relianee  on  unverifiable  online  news  sourees  introduees  the  possibility  of 
eompletely  falsified  news  stories  entering  the  mainstream  of  publie 
eonseiousness.  This  phenomenon,  eommonly  ealled  fake  news,  has 
generated  significant  criticism  from  both  sides  of  the  American  political 

spectrum,  with  some 
labeling  any  contrary 
viewpoints  fake.  In 
reality,  fake  news 
consists  of  more  than 
just  bad  headlines, 
buried  ledes,  or  poorly 
sourced  stories. 3o  Fake 
news  is  a  particular  form 
of  propaganda  comprised 
of  a  false  story  disguised 
as  news.  On  social  media, 
this  becomes  particularly  dangerous  because  of  the  viral  spread  of 
sensationalized  fake  news  stories. 

A  prime  example  of  fake  news  and  social  media  came  from  the 
most  shared  news  stories  on  Facebook  during  the  2016  US  presidential 
election.  The  source  of  the  fake  news  was  a  supposedly  patriotic 
American  news  blog  called  “End  the  Fed,”  a  website  run  by  Romanian 
businessperson  Ovidiu  Drobota.  One  story  stating  that  the  Pope 

29Jowett  and  O’Donnell,  300. 

30  According  to  Merriam-Webster.com,  “in  journalism,  the  lede  refers  to  the  introductory 
section  of  a  news  stoiy  that  is  intended  to  entice  the  reader  to  read  the  full  story.  It 
appears  most  frequently  in  the  idiom  ‘bury  the  lede.”’ 
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Source:  Craig  Silverman,  Buzzfeed  News 
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endorsed  Donald  Trump  for  President  reeeived  over  one  million  shares  on 
Faeebook  alone,  not  to  mention  shares  on  Twitter. Other  fake  news 
stories  from  that  site  and  others  reeeived  more  shares  in  late-2016  than 
traditional  mainstream  news  sourees  (see  Figure  5).32 

It  is  important  to  reeognize  that  more  people  were  exposed  to  those 
fake  news  stories  than  what  is  refleeted  in  the  “shares”  data.  In  some 
eases,  people  would  just  see  the  story  in  a  Faeebook  or  Twitter  feed;  in 
many  cases,  people  actively  sought  out  news  from  those  sources,  which 
are  fiction  at  best,  foreign  propaganda  at  worst.  Over  time,  those  fake 
news  sources  become  trusted  sources  for  some  people.  As  people  learn  to 
trust  those  sources,  legitimate  news  outlets  become  less  trustworthy. 

At  one  time,  the  American  public  had  confidence  in  the  news 
media;  a  1975  Roper  Organization  survey  found  the  majority  of 
respondents  thought  the  institution  was  trustworthy  and  unbiased,  with 
only  7  percent  of  everyone  polled  feeling  that  the  media  leaned  too  far  to 
the  political  left,  and  only  2  percent  felt  it  leaned  too  far  to  the  right. 33 
Conversely,  a  2016  poll  by  Gallup  showed  American  trust  in  mass  media 
is  at  an  all-time  low. 34 

Olcott’s  Six  Vs  are  relevant  to  modern  journalism,  particularly 
velocity,  volume,  and  vector.  When  news  is  tailorable  to  one’s  taste,  and 
new  stories  are  popping  up  around  the  world  every  second,  mainstream 
journalists  have  to  change  their  methods  to  compete  with  other  sources 
of  news.  Therefore,  if  social  media  is  becoming  a  source  for  spreading 
news  and  information,  journalists  must  keep  up  by  using  social  media  to 
spread  their  stories  and  to  acquire  information  in  the  first  place. 


Tess  Townsend,  "Meet  the  Romanian  Trump  Fan  Behind  a  Major  Fake  News  Site.” 
Inc.com,  November  21,  2016. 

22  Craig  Silverman,  "This  Analysis  Shows  How  Viral  Fake  Election  News  Stories 
Outperformed  Real  News  On  Faeebook.”  Buzzfeed  News.  November  16,  2016. 

22Alan  D.  Monroe,  Public  Opinion  in  America.  (New  York:  Dodd,  Mead,  1975),  121. 

24  Art  Swift,  "Americans'  Trust  in  Mass  Media  Sinks  to  New  Low.”  Gallup,  September  14, 
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According  to  an  Indiana  University  School  of  Journalism  study,  the 
most  eommon  use  of  soeial  media  for  journalists  is  to  eheek  for  breaking 
news. 35  One  reporter  emphasized,  “Everybody  in  the  media  is  on  Twitter. 
It  is  the  plaee  where  news  breaks  the  fastest.  When  something  is  going 
on  in  the  market,  I  don’t  Google  it  —  I  go  on  Twitter.”36  As  a  result, 
mainstream  journalists  tend  to  use  tweets  as  a  legitimate  souree, 
espeeially  when  there  is  a  laek  of  more  valid  or  eonfirmed  sourees.37 
Overreliance  on  social  media  for  breaking  news  can  become  problematic 
in  the  midst  of  an  ongoing  information  operation.  If  an  adversary  can 
take  control  of  a  trend  on  Twitter,  the  trend  is  likely  to  be  noticed  by 
mainstream  media  journalists.  Even  more  problematic,  the  mainstream 
media  may  provide  legitimacy  to  a  false  story  by  covering  the  topic — 
essentially  turning  fake  news  into  real  news. 


Weaponizing  Social  Media 

Web  2.0  laid  the  foundation  for  the  weaponization  of  social  media 
via  increased  computing  power,  mobile  technology,  and  the  increasing 
use  of  social  media  as  a  news  source.  To  summarize,  social  media  was 
originally  intended  to  bring  people  together  to  share  thoughts  and  ideas. 
Around  the  time  social  media  rose  in  popularity,  news  content  was 
continuing  to  move  from  print  and  television  to  online  sources.  The  two 
ideas  converged  when  News  Corp  bought  MySpace  in  2005,  providing 
more  control  for  consumers  of  news,  and  essentially  allowing  them  to 
become  producers  of  news.  Group  dynamics  are  unchanged  with  social 
media,  which  enables  people  to  hear  ideas  they  agree  with  instantly  and 


35  Andrea  Peterson,  “Three  charts  that  explain  how  U.S.  journalists  use  social  media.” 
The  Washington  Post.  May  06,  2014. 

35  Matt  Pressberg,  “Why  Even  Donald  Trump  Can’t  Save  Twitter.”  TheWrap.com.  March 
21,  2017. 

37  Weimann,  138. 
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whenever  they  ehoose;  and  they  ean  feel  eomfortable  knowing  that  they 
are  not  alone  in  their  thoughts.  This  is  the  initial  setup  for  how  soeial 
media  beeame  weaponized  via  an  adversary’s  propaganda. 

One  of  the  primary  prineiples  of  propaganda  is  that  the  message 
must  resonate  with  the  target.  Therefore,  when  presented  with 
information  that  is  within  your  belief  strueture,  your  bias  is  eonfirmed, 
and  you  aeeept  the  propaganda.  If  it  is  outside  of  your  network,  you  may 
initially  reject  the  story,  but  the  volume  of  information  may  create  an 
availability  heuristic  in  your  mind.  Over  time,  propaganda  becomes 
normalized,  and  even  believable  when  the  massive  amount  of 
information — even  if  it  is  disinformation  through  fake  news — starts  to 
seem  like  “what  you  see  is  all  there  is”  (WYSIATI).  WYSIATI  is  confirmed 
when  a  fake  news  story  is  reported  by  the  mainstream  media,  which  has 
become  reliant  on  social  media  for  spreading  and  receiving  news. 

Figure  6  maps  the  process  of  how  propaganda  can  penetrate  a 
network  that  is  not  predisposed  to  the  message.  This  outside  network  is 
a  group  that  is  ideologically  opposed  to  the  group  of  true  believers.  The 
outside  network  is  likely  aware  of  the  existing  narrative  but  does  not 
necessarily  subscribe  to  the  underl5dng  beliefs  that  support  the 
narrative.  The  mechanism  for  an  adversary  to  spread  propaganda  is  the 
social  media  trend.  A  synchronized  network  of  true  believers  and  hot 
accounts  can  create  or  hijack  a  trend.  Trending  items  produce  the 
illusion  of  reality;  in  some  cases  even  being  reported  by  journalists. 

The  next  two  chapters  are  case  studies  of  how  ISIS  and  Russia 
successfully  manipulated  social  media,  particularly  Twitter.  Although  the 
subjects  of  the  case  studies  had  different  objectives,  the  tools  and 
techniques  were  similar.  Foreign  actors  in  both  cases  utilized  four 
essential  elements  on  social  media  —  propaganda  narratives,  true 
believers,  cyber  warriors,  and  a  bot  network  —  to  spread  propaganda  that 
influenced  the  emotions,  opinions,  and  behavior  of  US  citizens  in  a 
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manner  antithetical  to  US  interests.  In  short,  ISIS  and  Russia 
weaponized  social  media  via  command  of  the  trend. 


Journalists 

Idea/Message 

Tweets 


Propaganda 

•  Hacked  Emails 

•  Forged  Documents/Videos 

•  Memes 

•  Fake  News 

•  Real  news  supporting  propaganda 

•  Threats 

•  Power  demonstration  videos/photos 


Bot  Network 


Other  Resources* 

Media  which  supports  propaganda 

State-owned  media 

Other  social  media  platforms 


I  *This  is  optional 

I _ 


Figure  6.  Process  map  of  how  propaganda  spreads  via  the  Trend 

Source:  Author 
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Chapter  2 


ISIS:  The  Genesis  of  Social  Media  Weaponization 


ISIL  blends  traditional  media  platforms,  glossy  photos,  in- 
depth  articles,  and  social  media  campaigns  that  can  go  viral 
in  a  matter  of  seconds.  No  matter  the  format,  the  message  of 
radicalization  spreads  faster  than  we  imagined  just  a  few 
years  ago. 


FBI  Director  James  Comey,  2015 


ISIS  is  either  a  large  terrorist  organization  or  a  very  fragile  state 
with  a  weak  army.  In  reality,  it  seems  to  be  more  of  the  latter  when 
compared  to  earlier  terrorist  organizations;  however,  the  perception  of 
ISIS  varies  depending  on  the  source.  ISIS  is  a  religious  caliphate  to 
believers  in  the  teachings  of  the  group  leader,  al-Baghdadi.  Much  of  the 
rest  of  the  world  assumes  that  ISIS  is  a  terrorist  group  that  represents  a 
perversion  of  faith.  That  viewpoint  fails  to  understand  the  intent  of  ISIS 
and  drastically  underestimates  the  group.  As  the  Commander  of  US 
Special  Operations  Command  (USSOCOM),  Major  General  Michael 
Nagata  suggested,  “We  have  not  defeated  the  idea”  because  “...we  do  not 
even  understand  the  idea.”i 

The  lack  of  understanding  of  ISIS  branding  was  a  contributing 
factor  for  the  failure  of  the  United  States,  and  the  international 
community,  to  establish  an  effective  counter-messaging  strategy  for  ISIS’ 
presence  on  social  media.  The  propaganda  produced  by  the  State 
Department,  for  example,  clearly  did  not  resonate  with  the  target 


1  Graeme  Wood,  “What  ISIS  Really  Wants.”  The  Atlantic.  Mareh  2015. 
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audience.  This  failure  to  communicate  was  mainly  because  the  audience 
was  never  truly  defined,  and  the  message  was  not  central  to  anyone’s 
worldview. 

ISIS,  on  the  other  hand,  managed  to  master  the  art  of 
manipulation  because  a  single  message  simultaneously  targeted 
potential  allies  and  foes  alike.  ISIS’  use  of  social  media  is  a  case  study  in 
effective  propaganda  techniques  that  bolstered  recruiting,  increased 
brand  recognition,  and  spread  terror  with  minimal  effort.  ISIS  quickly 
became  the  first  organization  to  weaponize  social  media  effectively.  This 
chapter  analyzes  the  organization  and  its  use  of  social  media  to  achieve 
its  goals. 


ISIS  Objectives 

The  biggest  misconception  when  observing  ISIS  at  a  superficial 
level  is  to  assume  that  ISIS  is  a  terrorist  organization.  Although  ISIS  may 
use  terrorism  as  a  tactic,  the  organization  behaves  differently  than  any 
other  terrorist  organization  in  the  world. 2  The  differences  are  apparent  in 
every  aspect  from  operations,  to  recruiting,  to  governing.  The  last  factor 
is  the  key  discriminator:  terrorist  groups  terrorize,  they  do  not  govern.  As 
a  descendant  of  al-Qaeda  in  Iraq,  the  group  struggled  to  find  its  way  after 
the  death  of  al-Zarqawi  in  2006;  under  the  leadership  of  al-Baghdadi  the 
group  has  established  clear  lines  of  authority,  taxation  and  educational 
systems,  trade  markets,  even  policing  and  a  judiciary  (covering  civil, 
criminal,  and  religious  complaints). ^  Gaining  and  holding  land  is  just  a 
part  of  what  ISIS  believes  is  the  destiny  of  the  organization  and  its 


2  Audrey  Kurth  Cronin,  “ISIS  Is  Not  a  Terrorist  Group”  Foreign  Policy.  March/April 
2015. 

3  Stephen  M.  Walt,  “ISIS  as  Revolutionary  State.”  Foreign  Policy,  November/ December 
2015,  42 
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followers.  Certainly,  the  desire  is  to  ereate  a  Caliphate, ^  but  its  ultimate 
purpose  is  more  apoealyptie  in  nature:  ISIS  seeks  to  usher  in  the  end  of 
the  world. ^  ISIS  members  believe  that  their  aetions  will  bring  the  forees 
of  the  world  to  attaek  their  Caliphate  and  result  in  the  imminent  defeat 
of  the  Islamie  army  in  the  Syrian  town  of  Dabiq,  thus  triggering  the  end 
of  the  world  and  the  final  purge  of  evil.^  ISIS  is  a  revolutionary  foree  with 
doomsday  eult  beliefs.'^ 

To  advance  the  organization’s  objectives,  ISIS  used  one  single 
message  that  served  to  spread  its  propaganda  on  social  media  to  a  broad 
audience  that  fit  within  a  narrative  of  strength  for  the  supporter,  and  a 
narrative  of  terror  for  the  adversary.  In  other  words,  ISIS  cyber  warriors 
combined  propaganda  with  command  of  the  trend  to  accomplish  three 
things  with  one  message.  First,  they  demonstrated  the  weakness  and 
incompetence  of  the  international  community  to  fight  them  online  and  on 
the  battlefield.  Secondly,  they  injected  terror  into  the  mainstream  media. 
Finally,  and  most  importantly,  they  recruited  new  fighters  to  join  them 
on  the  battlefield  in  Iraq  and  Syria — and  online. 


How  ISIS  Dominated  Social  Media 


Through  a  combination  of  slick  marketing  and  cyber  mastery,  ISIS 
bolstered  its  message  around  the  world.  The  first  thing  that  the  group 
refined  was  the  ISIS  branding.  The  organization  projects  a  very  specific 
image  to  the  world  that  affects  the  viewer  differently  based  on  beliefs.  To 
a  follower,  the  images  that  are  shared  via  social  media  demonstrate 


Caliphate:  “a  form  of  Islamic  government  led  by  a — a  person  considered  a  political  and 
religious  successor  to  the  Islamic  prophet,  Muhammad,  and  a  leader  of  the  entire 
Muslim  community.  Source:  Kadi,  Wadad  and  Shahin,  Aram  A.  “Caliph,  caliphate”.  The 
Princeton  Encyclopedia  of  Islamic  Political  Thought,  2013:  81-86. 

5  Wood,  3 

6  Dabiq  is  also  the  name  of  the  ISIS  magazine,  which  is  available  electronically  and 
spread  via  social  media. 

7  Walt,  43 
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strength  and  power.  To  the  non-follower,  the  images  are  grotesque  and 
horrifying.  In  other  words,  no  matter  what  ISIS  puts  out  in  soeial  media 
the  result  is  a  win  for  the  organization  beeause  the  same  message 
sueeessfully  targets  two  different  groups.  The  amplifieation  of  those 
messages  by  ereating  trends  on  Twitter  is  guaranteed  to  get  further 
attention  onee  the  tweet  falls  into  the  mainstream  media.  Thus,  ISIS  is 
eapable  of  using  relatively  small  numbers  of  Twitter  users  (see  Table  2, 
below)  to  project  an  aura  of  strength. 

The  method  for  expanding  the  reach  of  a  single  ISIS  tweet  or 
hashtag  involves  a  network  of  legitimate  retweets  combined  with  hots 
and  unwitting  Twitter  users.  While  ISIS  does  maintain  a  strong  network 
of  true  believers,  the  numbers  are  relatively  small  and  spread  thinly 
across  the  Middle  East.  Therefore,  ISIS  must  game  the  system  and  rig 
Twitter  for  a  message  to  go  viral.  One  high-tech  method  for  creating  a  hot 
network  was  a  mobile  app  called  “Dawn  of  Glad  Tidings.”  The  app, 
designed  by  ISIS  cyber  warriors,  provides  updates  on  ISIS  activities  and 
spiritual  guidance  to  the  user.  When  users  download  the  app,  they  create 
an  account  that  links  to  their  Twitter  account,  which  then  gives  the  app 
generous  permissions  allowing  the  app  to  tweet  using  that  user’s 
account. s  The  app  then  retweets  on  behalf  of  the  user  when  a  master 
account  sends  an  ISIS-branded  tweet. 

Over  time,  the  hashtag  generates  enough  tweets  to  start  loealized 
trends.  Onee  the  trend  surfaees,  it  is  broadeast  over  trend-monitoring 
networks,  like  the  Arabie  Twitter  aeeount,  @AetiveHashtags.^  That 
eauses  the  hashtag  to  gather  more  attention  aeross  the  region,  and  then 
be  retweeted  by  real  followers  and  other  hot  aeeounts.  The  final  step  in 
the  proeess  is  when  the  trend  goes  global. 


^  Berger,  "How  ISIS  Games  Twitter” 
^  Berger,  "How  ISIS  Games  Twitter” 
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Table  2.  Snapshot  of  ISIS  Twitter  Activity 


Estimated  number  of  overt  ISIS  Twitter  accounts 

46,000 

Number  of  “bot”  accounts 

6,216 

Avg  number  of  tweets  per  day  per  user 

7.3 

Avg  number  of  followers 

1,004 

Most  common  year  accounts  created 

2014 

Top  Languages 

Arabic  (73%),  English  (18%),  French  (6%) 

Top  Locations 

“Islamic  State,”  Syria,  Iraq,  Saudi  Arabia* 

Source:  “The  ISIS  Twitter  Census”  Brookings  Institute,  Mareh  20,  2015. 
*  Based  on  location-enabled  users  and  self-defined  account  locations 


Worldwide  trends  on  Twitter  have  been  a  boon  for  ISIS.  Creating 
and  hijacking  trends  garnered  attention  for  the  group  that  would 
otherwise  have  gone  unnoticed  on  social  media.  The  peak  of  ISIS  trend 
hijacking  was  during  the  World  Cup  in  2014.  As  one  of  the  world’s  most 
popular  sporting  events,  it  was  no  surprise  that  the  hashtag 
#WorldCup2014  trended  globally  on  Twitter  non-stop  during  the 
tournament.  At  one  point  though,  nearly  every  tweet  under  this  hashtag 
had  something  to  do  with  ISIS  instead  of  soccer.  The  network  of  ISIS 
supporters  and  hot  accounts  hijacked  the  trend.  Because  people  were 
using  the  hashtag  to  diseuss  the  matehes,  and  advertisers  were  using 
the  trend  for  marketing,  Twitter  struggled  to  stop  the  trend  and  the 
subsequent  ISIS  propaganda  effort. 

In  faet,  ISIS  eyber  warriors  and  true  believers  foiled  most  of  the 
early  attempts  by  Twitter  to  stop  ISIS  from  using  their  platform  to  spread 
propaganda.  Twitter’s  initial  reaetion  was  to  suspend  aeeounts  that 
violated  the  user  terms  of  the  agreement.  The  result  was  ereative  user 
names  by  ISIS  supporters;  for  example,  a  user  named  @jihadISIS42  was 
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created  after  @jihadISIS4 1  was  suspended,  whieh  was  set  up  after 
@jihadISIS40  was  suspended.^®  Eaeh  new  aeeount  demonstrated  a  deep 
dedieation  to  the  eause  that,  when  eombined  with  the  seemingly 
signifieant  presenee  on  soeial  media,  presented  the  group  as  dominating 
soeial  media. 

In  the  ease  of  #WorldCup2014,  ISIS  took  eommand  of  the  trend  by 
hijaeking,  using  the  opportunity  to  push  reeruiting  messages,  and  make 
terror  threats  against  the  tournament  venues  in  Brazil.  Additionally,  the 
co-opted  hashtag  often  directed  users  to  other  hashtags  in  what  was 
ultimately  a  successful  attempt  to  generate  worldwide  trends  of  other 
ISIS  related  themes.  One  successful  hashtag-creation  effort  was 
#StevensHeadinObamasHands,  which  included  memes  of  President 
Obama  and  ISIS-held  American  journalist  Steven  Sotloff  (example  in 
Figure  5).  The  implication 
was  that  the  President  of  the 
United  States  did  not  care  to 
or  was  powerless  to  stop  the 
murder  of  an  American 
citizen.  Once  again,  ISIS 
appeared  to  be 
disproportionately  powerful 
beeause  of  the  eommand  of 
the  trend. 

Due  to  the 

organization’s  aggressive 
eommunieations  strategy  and 
branding,  the  ISIS  soeial 
media  presenee  eonsistently 

10  “Terrorist  Use  of  Soeial  Media:  Poliey  and  Legal  Challenges”  DC  Roundtable  Forum. 
Council  on  Foreign  Relations.  October  14,  2015. 


/-■disJ. 


O  i  Follow 


Hey  American ..  This  picture  is  a  copy  of  the 
reality  that  you  all  are  not  aware  of  it ! 

tfStevensHeadinObamasHands 


WHY  WOULD  I  CARE  ABOUT  HIM  ? 
#StevensHea(jinObamasHands 


Figure  7.  ISIS  hashtag  creation,  2014 

Souree:  Sereenshot,  unknown  user, 
Twitter,  eom 
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outperforms  similar  jihadist  groups  in  the  region  that  have  the  same 
number  of,  or  more,  followers. Unlike  al-Qaeda,  whieh  largely  limited 
its  online  aetivity  to  websites,  ISIS  wants  to  eommunieate  with  a  broader 
audienee — it  wants  to  eommunieate  direetly  to  the  whole  world.  In 
addition  to  spreading  terror  threats,  the  appearanee  of  the  group  as  a 
powerful  state  appealed  to  a  group  of  true  believers  who  turned  to  the 
group  as  new  reeruits  to  the  fight  in  Iraq  and  Syria. 


The  Recruits 

Years  of  researeh  and  profiling  to  determine  an  aeeurate 
demographie  for  radiealization  have  resulted  in  “few  eonsistent  patterns 
and  no  reliable  profile.”  12  Terrorist  groups  like  al-Qaeda  historieally 
targeted  religiously  passionate  and  disenfranehised  Middle  Eastern 
young  men.  ISIS,  on  the  other  hand,  reeruits  worldwide  from  both  sexes 
and  every  age  and  level  of  religiosity.  While  there  may  not  be  speeifie 
demographics,  there  are  essentially  three  motivations  for  recruits: 
religion,  fear,  and  adventure,  each  of  which  can  be  advertised  using 
appealing  videos  and  photos  spread  on  social  media. 

ISIS’  objectives  make  the  group  particularly  appealing  to  those  who 
desire  increased  piety.  One  oddity  in  ISIS  recruiting  is  the  slaughter  of 
fellow  Muslims.  Al-Qaeda  sought  to  recruit  fervently  religious  men; 
hence,  they  carefully  avoided  harming  fellow  Muslims  to  prevent 
offending  devout  pledges.  Ironically,  ISIS  is  “impervious  to  the  risk  of 
backlash”  from  killing  Muslims;  in  fact,  the  caliphate  bolsters  its  image 
and  gets  recruiting  bumps  with  nearly  every  execution  video. These 

Berger,  “How  ISIS  Games  Twitter” 

J.  M.  Berger,  “ISIS  and  the  Foreign-Fighter  Phenomenon.”  The  Atlantic.  March  8, 
2015. 

13  Cronin,  3. 

14  Cronin,  3. 
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post-execution  recruiting  spikes  imply  two  things.  First,  they  are 
garnering  support  from  those  who  genuinely  believe  that  al-Baghdadi  is 
the  caliph.  These  true  believers  would  interpret  the  murders  as 
admissible  killings  for  the  crime  of  apostasy.  Second,  ISIS  gained 
support  from  those  who  fear  ending  up  like  the  helpless  souls  horrifically 
murdered  for  lack  of  support  or  their  perceived  lack  of  holiness. 

Interviews  with  imprisoned  ISIS  members  in  Iraq  revealed  a  common 
desire:  security  for  themselves  and  their  families.  ISIS  provided  an  outlet 
for  them  to  fight  for  the  dignity  of  themselves,  their  family,  and  their 
tribe.  in  exchange,  the  fighter  and  family  live  without  fear  of  accusation 
of  being  “apostates.”!''  Once  again,  ISIS  can  use  social  media  to  spread 
fear  in  support  of  their  objectives  while  using  those  same  images  to  spark 
an  interest  among  the  true  believers. 

Most  of  the  ISIS  true  believer  recruits  from  the  Middle  East  and 
abroad  join  for  a  variety  of  factors,  including  adventure  and  prestige. 
These  notions  are  exploited  by  ISIS  propaganda  on  social  media.  Erin 
Saltman,  a  researcher  at  the  Institute  for  Strategic  Dialog,  summarized 
the  vast  majority  of  ISIS  recruiting  “plays  upon  the  desires  of  adventure, 
activism,  romance,  power,  belonging,  along  with  spiritual  fulfillment. 
Evidence  of  this  fantasy  world  is  apparent  in  ISIS-produced  recruiting 
videos,  tweets,  and  even  computer  games  (see  Figure  8). 

ISIS  used  social  media  from  2014-2016  to  demonstrate  power,  sow 
fear  in  the  international  audience,  and  recruit  the  true  believers.  All  the 
while,  they  used  the  true  believers  following  on  social  media  to  boost 
their  trends  on  social  media.  However,  the  group  currently  finds  itself 
altering  its  modus  operandi  due  to  the  recent  loss  of  territories  in  Iraq 


15  Apostasy  is  the  abandonment  of  a  particular  religion.  Some  interpret  Quarnic  verses 
to  read  that  the  punishment  for  apostasy  is  death  within  Sharia  Law. 

15  Lydia  Wilson,  “What  1  Discovered  From  Interviewing  Imprisoned  ISIS  Fighters.”  The 
Nation.  October  21,  2015. 

17  Wood,  10. 

18  Wood,  10. 
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Figure  8.  Familiar  Narratives:  ISIS  Video  Game  Propaganda 

Source:  “Networking  in  the  Market  for  Loyalties,”  Sharma 


and  Syria,  combined  with  a  spate  of  successful  terrorist- style  attacks  in 
Europe.  The  ongoing  worry  for  counter-terrorism  experts  is  finally 
beginning  to  come  to  fruition:  the  recruit  staying  home  to  fight,  instead  of 
joining  ISIS  overseas. 


The  Lone  Wolf 

After  years  of  maintaining  a  significant  presence  on  social  media, 
ISIS  is  using  Twitter  less  now  for  official  communication.  The  reasoning 
is  likely  two-fold.  First,  the  group  has  lost  territory  in  Iraq  and  Syria  and 
is  adjusting  their  strategies.  Secondly,  Twitter  has  removed  over  600,000 
ISlS-related  accounts  consisting  of  hots,  cyber  warriors,  and  true 
believers.  Additionally,  Twitter  has  adjusted  the  program  to  find  terror- 
related  videos,  memes,  and  photos  soon  after  an  account  from  the  ISIS 
network  posts  the  propaganda.  Adapting  to  the  changes,  ISIS  started 


Carleton  English,  “Twitter  continues  to  wage  its  own  war  against  iSiS.”  New  York 
Post,  March  21,  2017. 
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using  secure  messaging  tools  like  Telegram  and  WhatsApp.  Messaging 
services  like  WhatsApp  are  not  publicly  visible;  therefore,  the  ISIS 
message  is  not  spread  across  networks  the  way  it  once  was  using  Twitter 
to  gain  command  of  the  trend.  Instead,  the  organization  can  still  spread 
a  message  rapidly  across  their  network  of  cyber  warriors  and  true 
believers  using  secure  messaging  tools,  and  it  can  be  done  with  little  risk 
of  detection.  In  fact,  one  of  ISIS’  best-known  recruiter’s  Twitter  profile 
“instructed  newcomers  to  contact  him  via  the  encrypted  messaging  app 
Telegram. ”20  It  is  uncertain  how  this  messaging  will  impact  recruiting 
goals,  but  what  is  certain  is  that  it  allows  ISIS  recruiters  to  aid  foreign 
fighters  in  planning  attacks  around  the  world.  21 

The  added  benefit  of  the  “lone  wolf’  brand  of  terrorism  recruits  is 
that  an  attack  can  dominate  the  trends — and  the  headlines — albeit 
differently  than  trend  hijacking  or  creation  using  a  hot  network.  Media 
coverage  of  lone  wolf  attacks  fans  the  flames,  and  the  message  still 
spreads  by  way  of  the  trend.  The  more  people  talk  about  the  event,  the 
more  the  ISIS  message  spreads  without  the  group  creating  propaganda. 
Presumably,  this  free  advertising  generated  by  an  individual  acting  alone 
after  pledging  allegiance  to  ISIS  has  the  same  effect  on  the  psyche  of  its 
victims  and  possible  recruits  as  original  social  media  campaigns  from 
2014-2016.  The  trend  draws  attention  to  the  group,  creates  fear,  and 
creates  more  recruits  who  then  attempt  to  mimic  the  original  lone  wolf 
attack.  The  cycle  repeats,  and  ISIS  maintains  a  narrative  of  strength.  In 
short,  ISIS  was  able  to  do  the  same  thing  without  attacks  on  foreign  soil 
by  taking  command  of  the  trend  but  now  requires  a  lone  wolf  attack  to 
create  trends  because  of  the  diminished  power  of  their  cyber  warrior  and 
hot  network. 


20  Rukmini  Callimachi,  “Not  ‘Lone  Wolves’  After  All:  How  ISIS  Guides  World’s  Terror 
Plots  From  Afar.”  The  New  York  Times.  March  5,  2007. 

21  Lizzie  Dearden,  “Khalid  Masood:  Suspected  Isis  supporter  used  WhatsApp  two 
minutes  before  London  attack.”  The  Independent.  March  24,  2017. 
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Summary 


With  ISIS  seemingly  dominating  soeial  media  from  2014-2016,  it  is 
easy  to  fixate  on  that  impression  and  assume  that  they  won  popular 
support.  The  faet  is  that  ISIS  only  has  a  limited  number  of  fighters,  and 

its  support  around  the  world — even 
in  Muslim  eountries — is  minuseule 
(see  Figure  7). 22  The  fact  that  the 
group  appeared  so  strong  on  social 
media  is,  quite  simply,  proof  that 
command  of  the  trend  is  an 
effective  tool  for  amplifying  voices 
and  projecting  power.  One  of  the 
reasons  ISIS  seems  so  powerful  is 
that  when  viewed  through  the  lens 
of  terrorist  groups,  the  organization 
seems  vast  because  terrorist  groups 
do  not  have  territory — ISIS  does, 
and  it  advertises  that  fact  using 
weaponized  social  media 
campaigns.  Its  slick  social  media 
presence,  ghastly  videos,  massive 
recruiting,  and  victories  against 
Iraqi  security  forces  make  ISIS  seem  disproportionately  stronger  than  it 
is.  The  group  overran  Mosul  with  only  a  few  thousand  fighters,  but  the 
corresponding  viral  social  media  campaign  implied  a  large  force  had  just 
earned  a  massive  victory.  23 


Views  of  ISIS  Overwhelmingly  Negative 

Do  you  have  a _ opinion  of  the  Islamic  militant  grout 

in  Iraq  and  Syria  known  as  ISIS? 


■  Unfavorable  ■  Favorable  Don'tk^ov^ 


Figure  9.  Muslim  opinion  of  ISIS 

Source:  In  Nations  with  Significant 
Muslim  Populations,  Much  Disdain 
for  ISIS,”  Pew  Research. 


22  “In  Nations  with  Significant  Muslim  Populations,  Much  Disdain  for  ISIS.”  Pew 
Research  Center.  November  17,  2015. 

23  Berger,  “How  ISIS  Games  Twitter.” 
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In  summation,  ISIS  serves  as  a  model  for  any  non-state  group 
attempting  to  use  soeial  media  for  eyber  warfare.  Soeial  media, 
speeifieally  Twitter,  made  the  organization  appear  to  be  more  potent  and 
highly  regarded  than  it  is,  and  it  amplified  the  voiees  of  supporters  and 
potential  reeruits.  Table  3  summarizes  ISIS’  use  of  the  four  requirements 
to  gain  eommand  of  the  trend  (propaganda  narratives,  true  believers, 
eyber  warriors,  and  a  bot  network)  based  on  the  analysis  within  this  ease 
study. 

Table  3.  ISIS  Case  Study  Analysis 


Propaganda 

Narratives 

1 .  ISIS  is  strong;  everyone  else  is  weak. 

2.  True  believers  should  join  the  cause. 

True 

Believers 

Muslims  believing  in  the  Caliphate  of  al-Baghdadi 

Cyber 

Warriors 

Propaganda  makers,  video  editors,  app  programmers, 
recruiters,  spiritual  leaders  using  low  and  high-tech  tools 
to  advertise  ISIS  on  Social  media. 

Bot  Network 

Unwitting  victims  of  spiritual  guidance  app  "Dawn  of  Glad 
Tidings." 

Source:  Author 


At  the  same  time  ISIS  was  weaponizing  Twitter,  Russia  was  using 
it  to  simultaneously  cause  confusion  and  garner  support  for  its  invasion 
of  Crimea;  2014  marked  the  beginning  of  influence  operations  in  Europe, 
culminating  in  a  massive  disinformation  campaign  following  the  shoot- 
down  of  Malaysia  Airlines  Flight  17  in  July.  Soon,  the  command  of  the 
trend  would  be  used  by  a  state  actor  to  target  the  United  States — 
Russian  involvement  in  the  2016  Presidential  Election. 
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Chapter  3 


Russia:  Masters  of  Manipulation 


I’m  warning  you:  We  are  at  the  verge  of  having  ‘something’  in 
the  information  arena,  which  will  allow  us  to  talk  to  the 
Americans  as  equals. 


Senior  Kremlin  Advisor  Andrey  Krutskikh,  2016 


Russia  is  no  stranger  to  information  warfare.  During  the  Cold  War, 
Soviet  agents  used  “forgeries  and  press  placements  to  disparage 
candidates”  in  the  United  States  and  around  the  world.  ^  Nowhere  was 
the  Soviet  campaign  more  noticeable  than  with  the  change  of  French 
attitudes  because  of  a  “slow  penetration  by  propaganda.”  Throughout  the 
1950s,  France  noticed  a  dramatic  shift  of  the  political  spectrum  to  the 
left,  resulting  in  the  election  of  communist  and  socialist  candidates. ^ 

The  original  technique  of  Soviet  actors  was  through  “aktivnyye 
meropriyatiya”  (active  measures)  and  “dezinformatsiya”  (disinformation). 
According  to  a  1987  State  Department  Report  on  Soviet  information 
warfare,  “Active  measures  are  distinct  both  from  espionage  and 
counterintelligence  and  from  traditional  diplomatic  and  informational 
activities.  The  goal  of  active  measures  is  to  influence  opinions  and/or 
actions  of  individuals,  governments,  and/or  publics. ”3 

In  other  words,  Soviet  agents  would  try  to  weave  propaganda  into 
an  existing  narrative  to  smear  countries  or  individual  candidates.  For 

1  ODNI  Report,  5. 

2  Ellul,  288. 

^United  States  Department  of  State,  Report:  Soviet  Influence  Activities:  A  Report  on 
Active  Measures  and  Propaganda,  1986-87,  (Washington  D.C.:  Bureau  of  Public  Affairs, 
1987),  viii. 
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example,  the  same  report  suggests  that  various  rumors  about  the  spread 
of  AIDS  during  the  1980s  were  proliferated  beeause  of  Soviet  aetive 
measures.  One  narrative  stated  that  the  Department  of  Defense  was 
responsible  for  the  epidemie  after  ereating  the  virus  as  a  biologieal 
weapon. 4  The  AIDS  rumor  was  published  in  newspapers  around  the 
world  based  on  studies  from  front  organizations  within  aeademia,  as  well 
as  using  supposed  experts  to  give  speeehes  in  universities  and  think 
tanks  in  the  United  States  and  Europe. 

Active  measures  are  designed,  as  retired  KGB  General  Oleg 
Kalugin  once  explained. 


To  drive  wedges  in  the  Western  community  alliances  of  all 
sorts,  particularly  NATO,  to  sow  discord  among  allies,  to 
weaken  the  United  States  in  the  eyes  of  the  people  in 
Europe,  Asia,  Africa,  Latin  America,  and  thus  to  prepare 
ground  in  case  the  war  really  occurs.  The  most  common 
subcategory  of  active  measures  is  dezinformatsiya,  or 
disinformation:  feverish,  if  believable  lies  cooked  up  by 
Moscow  Centre  and  planted  in  friendly  media  outlets  to 
make  democratic  nations  look  sinister. ^ 


The  techniques  that  Russia  uses  today  are  similar  to  the  Cold  War, 
but  the  dissemination  is  more  widespread  through  the  weaponization  of 
social  media.  Recently,  the  Russian  Minister  of  Defense  acknowledged 
the  existence  of  their  cyber  warriors  in  a  speech  to  the  Russian 
Parliament,  by  announcing  that  Russia  formed  a  new  branch  of  the 
military  consisting  of  information  warfare  troops. ^  Unlike  non-state 
actors  like  ISIS  trying  to  generate  buzz  on  Twitter,  Russia  possesses  both 
a  history  of  spreading  propaganda  and  an  army  of  professional  trolls 
whose  mission  is  to  fight  online. 


Soviet  Influence  Activities,  34. 

5  Natasha  Bertrand,  “It  looks  like  Russia  hired  internet  trolls  to  pose  as  pro-Trump 
Amerieans.”  Business  Insider,  July  27,  2016. 

®  Vladimir  Isachenkov,  "Russia  military  acknowledges  new  branch:  info  warfare  troops." 
AP  News.  February  22,  2017. 
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Unlike  ISIS  cyber  warriors,  the  Russian  trolls  have  a  variety  of 
state  resources  at  their  disposal,  including  a  vast  intelligence  network  to 
assist  their  cyber  warriors.  The  additional  tools  available  to  Russia  also 
include  RT  (Russia  Today)  and  Sputnik,  the  Kremlin-financed  television 
news  networks  broadcasting  in  multiple  languages  around  the  world. 
According  to  the  Office  of  Director  of  National  Intelligence  (ODNI)  Report 
on  Russian  Influence  in  the  2016  US  Presidential  Election,  “Moscow’s 
influence  campaign  followed  a  messaging  strategy  the  blends  covert 
intelligence  operations — such  as  cyber  activity — ^with  overt  efforts  by 
Russian  Government  agencies,  state  funded  media,  third-party 
intermediaries,  and  paid  social  media  users,  or  ‘trolls. 

Before  the  trolls  begin  their  activities  on  social  media,  the  cyber 
warrior  hackers  first  provide  hacked  information  to  Wikileaks,  which 
according  to  CIA  director  Mike  Pompeo,  is  a  “non-state  hostile 
intelligence  service  abetted  by  state  actors  like  Russia. In  intelligence 
terms,  WikiLeaks  operates  as  a  “cutout”  for  Russian  intelligence 
operations — a  place  to  spread  intelligence  information  through  an 
outside  organization — similar  to  the  Soviets  use  of  universities  to  publish 
propaganda  studies  in  the  1980s. ^  The  trolls  then  take  command  of  the 
trend  to  spread  the  hacked  information  on  Twitter,  referencing  WikiLeaks 
and  links  to  RT  news  within  their  tweets. 

These  Russian  efforts  would  be  impossible  without  an  existing 
network  of  American  true  believers  willing  to  spread  the  message.  In  the 
case  of  the  2016  election,  Russian  propaganda  easily  meshed  with  right- 
wing  networks  known  as  the  “alt-right”  and  the  so-called  “Bernie  Bros,” 
who  lashed  out  on  Twitter  because  Hillary  Clinton  beat  Senator  Bernie 
Sanders  in  the  Democratic  Party  primary.  The  Russian  trolls  and  the  bot 

ODNI  Report,  “Key  Judgements,”  ii. 

8  Richard  Gonzalez,  “CIA  Director  Pompeo  Denounces  WikiLeaks  As  'Hostile  Intelligence 
Service.”  NPR.  April  23,  2017. 

9  Malcolm  Nance,  The  Plot  to  Hack  America:  How  Putin’s  Cyberspies  and  WikiLeaks  Tried 
to  Steal  the  2016  Election.  (Skyhorse  Publishing.  Kindle  edition,  2016),  1,839. 
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accounts  amplified  the  voiees  of  the  true  believers  in  addition  to  inserting 
propaganda  into  that  network.  Then,  the  eombined  effeets  of  Russian 
and  Ameriean  Twitter  aeeounts  took  eommand  of  the  trend  to  spread 
disinformation  aeross  networks. 

Before  2016,  Russian  aetive  measures  were  also  used  in  European 
eleetions,  most  notably  the  “Brexit”  eampaign.  One  European  expert  on 
Russia  quoted  in  The  Atlantic  artiele  “War  Goes  Viral”  summarized 
Putin’s  intent  as,  “not  to  make  you  love  Putin,”  instead,  “the  aim  is  to 
make  you  disbelieve  an5hhing.  A  disbelieving,  fragile,  unconscious 
audience  is  much  easier  to  manipulate. Active  measures  enable 
manipulation.  Smearing  political  candidates,  hacking,  the  spread  of 
disinformation,  and  hoaxes  all  contribute  to  a  breakdown  of  public  trust 
in  institutions. 


Active  Measures  and  Disinformation 

On  September  11,  2014,  the  small  town  of  St.  Mary  Parish, 
Louisiana,  was  briefly  thrown  into  a  panic  when  residents  began  hearing 
reports  through  text,  social  media,  and  on  local  television  stations  that  a 
nearby  chemical  plant  fire  was  spreading  toxic  fumes  that  would  soon 
endanger  the  whole  town.  A  reasonable  snap-judgement  would  imply  the 
anniversary  of  9/ 1 1  meant  the  fire  was  likely  an  act  of  terrorism  and  the 
casualties  would  be  high.  However,  the  tragedy  of  this  story  is  not  the 
loss  of  life;  it  is  that  the  panic  was  based  on  a  hoax.  The  entire  narrative 
was  based  on  falsified — but  very  real  looking — online  news  stories, 
hashtag  manipulation,  and  mass-texts  (SMS)  to  various  numbers  with 
the  local  area  code  and  dialing  prefix.  The  story  developed  so  quickly  and 
was  so  sensational  that  local  news  outlets  had  no  choice  but  to  cover  the 


Robinson  Meyer,  “War  Goes  Viral:  How  Social  Media  is  Being  Weaponized  Across  the 
World.”  The  Atlantic.  October  18,  2016. 
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situation  as  soon  as  possible.  The  aetual  souree  for  the  news  was  not  the 
ehemieal  faetory;  it  was  a  nondeseript  building  in  St.  Petersburg,  Russia, 
where  an  army  of  online  eyber-warrior  trolls  seeks  to  distribute  false 
information.il 

The  Internet  Researeh  Ageney,  as  it  was  ealled  in  2015,  now  seems 
to  be  the  information  warfare  braneh  openly  admitted  by  the  Russian 
Minister  of  Defense.  The  eyber  trolls  produeed  several  hoaxes  in  the 
United  States  and  Europe,  like  the  Louisiana  hoax,  according  to  Adrian 
Chen  in  his  article  “The  Agency”  in  The  New  York  Times  Magazine. 
Protests  of  police  departments  throughout  the  United  States  during  the 
summer  of  2015  provided  several  opportunities  to  manipulate  narratives 
via  social  media,  and  it  is  likely  that  Russian  trolls  hijacked  some  of  the 
Black  Lives  Matter  related  trends  to  spread  disinformation  and  accusing 
journalists  of  failing  to  cover  important  issues.  12  The  Russian  trolls  said 
that  the  idea  was  to  spread  fear,  discrediting  institutions — especially 
American  media — ^while  making  President  Obama  look  powerless  and 
Putin  more  favorable. ^ 3 

Several  hijacked  hashtags  in  2015  attempted  to  discredit  the 
Obama  administration  while  spreading  racist  memes  and  hoaxes  aimed 
at  the  African-American  community.  In  other  words,  the  Russian  trolls 
seemed  to  target  multiple  groups  to  generate  anger  and  create  chaos. 

One  particularly  effective  Twitter  hoax  occurred  as  racial  unrest  fell  on  a 
university  campus  that  fall. 

#PrayforMizzou 


Adrain  Chen,  “The  Agency.”  New  York  Times  Magazine,  June  2,  2015. 

12  Senate  Intelligence  Committee  Testimony,  “Disinformation:  A  Primer  In  Russian 
Active  Measures  And  Influence  Campaigns”  Clint  Watts,  March  30,  2017. 

13  Chen,  “The  Agency.” 
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On  the  night  of  November  11,  #PrayforMizzou  began  trending  on 
Twitter,  The  trend  was  a  result  of  protests  at  the  University  of  Missouri 
eampus  over  raeial  issues;  however,  “news”  slowly  started  developing 
within  the  hashtag  that  altered  the  meaning,  and  soon  shot  the  hashtag 
to  the  top  of  the  trend  list.  The  news  was  that  the  KKK  was  marehing 
through  Columbia  and  the  Mizzou  eampus.  One  user,  display  name, 
“Jermaine”  (@Fanfanl91 1),  warned  residents  “The  eops  are  marehing 
with  the  KKK!  They  beat  up  my  little  brother!  Watch  out!”  Jermaine’s 
tweet  included  a  picture  of  a  black  child  with  a  severely  bruised  face;  it 
was  retweeted  hundreds  of  times.  Additionally,  Jermaine  and  a  handful 
of  other  users  continued  tweeting  and  retweeting  images  and  stories  of 
KKK  and  neo-Nazis  in  Columbia,  chastising  the  media  for  not  covering 
the  racists  creating  havoc  on  campus. 

Looking  at  Jermaine’s  followers,  and  the  followers  of  his  followers, 
one  could  observe  that  the  original  tweeters  all  followed  and  retweeted 
each  other.  Those  users  also  seemed  to  be  retweeted  automatically  by 
approximately  70  hots.  These  hots  also  used  the  trend  distribution 
technique,  which  used  all  of  the  trending  hashtags  at  that  time  within 
their  tweets,  not  just  #PrayforMizzou.  Spaced  evenly,  and  with  retweets 
of  real  people  who  were  observing  the  Mizzou  hashtag,  the  numbers 
quickly  escalated  to  thousands  of  tweets  within  a  few  minutes.  The  plot 
was  smoothly  executed  and  evaded  the  algorithms  Twitter  designed  to 
catch  hot  tweeting,  mainly  because  the  Mizzou  hashtag  was  being  used 


14  Because  of  the  Adrian  Chen  article,  I  observed  particular  tweeting  patterns  of  certain 
individuals  involved  in  a  hoax  on  the  campus  of  the  University  of  Missouri  that  seemed 
to  match  the  methods  of  the  Russian  trolls  interviewed  by  Chen.  I  mention  only  one 
particular  user  in  this  paper,  but  I  also  monitored  a  dozen  or  so  accounts  that 
contributed  to  that  hoax.  Each  account  followed  a  pattern  that  also  happened  to  align 
with  noted  Russian  influence  operations  in  Europe  and  eventually  in  the  US 
presidential  election.  1  describe  that  transition  below.  From  those  accounts,  I  built  a 
database  of  suspected  Russian  hot  accounts  to  build  the  network  map  in  Figure  13.  The 
Mizzou  hoax  was  a  trend  hijacking  effort  launched  by  actors  who  later  proved  to  match 
the  Russian  modus  operandi  of  using  cyber  trolls  originally  observed  by  Adrian  Chen, 
and  confirmed  by  the  ODNl  report  and  Foreign  Policy  Research  Institute  Fellow  Clint 
Watts  in  his  testimony  before  the  Senate  Intelligence  Committee. 
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outside  of  that  attack.  The  narrative  was  set  as  the  trend  was  highjacked, 
and  the  hoax  was  underway. 

The  rapidly  spreading  image  of  a  bruised  little  boy  was  generating 
legitimate  outrage  across  the  country  and  around  the  world.  However,  a 
quick  Google  image  search  for  “bruised  black  child”  revealed  the  picture 
that  “Jermaine”  attached  to  the  tweet  was  a  picture  of  an  African- 
American  child  who  was  beaten  by  police  in  Ohio  over  one  year  earlier. 
The  image  and  the  narrative  were  part  of  a  larger  plot  to  spread  fear  and 
distrust.  It  worked. 

The  University  of  Missouri  student  body  president  tweeted  a 
warning  to  stay  off  the  streets  and  lock  doors  because  “KKK  members 
were  confirmed  on  campus.”  National  news  networks  broke  their 
coverage  to  get  a  local  feed  from  camera  crews  roaming  Columbia  and 
the  campus  looking  for  signs  of  violence.  As  journalists  continued  to 
search  for  signs  of  Klan  members,  anchors  read  tweets  describing 
shootings,  stabbings,  and  cross-burnings.  In  the  end,  the  stories  were  all 
false. 


Shortly  after  the  disinformation  campaign  at  Mizzou,  @Fanfanl91 1 
changed  his  display  name  from  Jermaine  to  just  “FanFan”  and  the  profile 
picture  of  a  young  black  male  changed  to  the  image  of  a  German  iron 

H  Payton  Head 

I'm  sorry  about  the  misinromnatk>n  that  I  have  shared  through  social  media.  In 
a  state  of  alarm,  I  was  concerned  for  all  students  of  the  University  of  Missouri 
and  wanted  to  ensure  that  everyone  was  safe.  I  received  and  shared 
information  from  multiple  incorrect  sources,  which  I  deeply  regret.  The  last 
thing  needed  is  to  incite  more  fear  in  the  hearts  of  our  community.  In  the 
future,  please  receive  emergency  updates  from  MUalert.missoun.edu  or 
OMUalert  on  Twitter  ONLY. 

Figure  10.  Mizzou  student  body  president’s  apology  on  Facebook 

Source:  Facebook  screenshot 


cross.  The  next  few  months  FanFan’s  tweets  were  all  in  German  and 
consisted  of  spreading  rumors  about  Syrian  refugees.  Russian  active 
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measures  in  Europe  around  this  time  were  widely  reported,  and  the 
aeeount  that  previously  tweeted  disinformation  regarding  Mizzou  now 
foeused  on  anti-lslamie,  anti-EU,  and  anti-German  Chaneellor  Angela 
Merkel  messages.  His  tweets  reaehed  a  ereseendo  after  reports  of  women 
being  raped  on  New  Year’s  Eve  2016.  Some  of  the  reports  were  false, 
ineluding  a  high-profile  ease  of  a  13-year-old  ethnie-Russian  girl  living  in 
Berlin  who  falsely  elaimed  that  she  was  abdueted  and  raped  by 
refugees.  15  Once  again,  Russian  propaganda  dominated  the  narrative. i® 

Like  in  previous  disinformation  campaigns  on  Twitter,  the 
Russians  trolls  were  able  to  spread  the  information  because  of  an 
underl5dng  fear  and  an  existing  narrative  that  they  were  able  to  exploit. 
The  trolls  used  trend  highjacking  techniques  in  concurrence  with 
reporting  by  Russian  state-funded  television  Russia  Today  (RT)  network. 
To  attempt  to  generate  more  attention  to  the  Russian  anti-Merkel 
narrative  in  European  media,  Russian  Foreign  Minister  Sergey  Lavrov 
accused  German  authorities  of  a  “politically  correct  cover-up”  in  the  case 
of  the  Russian  teen.i'' 

Because  of  the  Russian  propaganda  push,  the  anti-immigration 
narrative  began  spreading  across  traditional  European  media,  in  fact,  a 
magazine  in  Poland  devoted  an  entire  issue  to  the  topic  of  Muslim 
immigration  with  a  disturbing  cover  photo  entitled  “Islamic  Rape  of 
Europe”  (Figure  11). 


15  Nadine  Schmidt  and  Tim  Hume,  “Berlin  teen  admits  fabricating  migrant  gang-rape 
stoiy,  official  says.”  CNN.com,  February  1,  2016. 

15  Judy  Dempsey,  “Russia’s  Manipulation  of  Germany’s  Refugee  Problems.”  Carnegie 
Europe,  January  28,  2016. 

11'  Schmidt  and  Hume,  “Berlin  teen  admits  fabricating  migrant  gang-rape  story,  official 
says.” 

15  Barbara  Tasch,  'The  aim  is  to  weaken  the  West':  The  inside  story  of  how  Russian 
propagandists  are  waging  war  on  Europe.  Business  Insider.  February  2,  2017. 
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Figure  11.  “Islamic  Rape  of 
Europe” 

Source:  wSieci  Magazine 


propaganda  narrative. 

Additionally,  the  troll 
network  already  seeded 
various  social  media  platforms 
with  pages  designed  for 
spreading  disinformation.  Seemingly  patriotic  American  Facebook 
pages  linked  articles  to  RT,  legitimate  American  news  sources  advocating 
a  right-leaning  perspeetive,  Breitbart,  right-wing  eonspiraey  sites  like 
InfoWars,  and  non-faetual  news  sites  like  The  Conservative  Tribune  and 
Gateway  Pundit.  The  Faeebook  pages  also  linked  to  Russia-run  sites  with 
nothing  but  false  news  stories.  Based  on  Anti-Obama  sentiment,  the 
Faeebook  pages  were  popular  amongst  eonservative  users,  but  not 
getting  broad  exposure.  As  the  2016  eampaign  began  in  earnest,  mueh  of 
the  online  animosity  was  now  direeted  at  Obama’s  potential  sueeessor: 
Hillary  Clinton,  who,  in  the  summer  of  2016  gave  a  speeeh  that  beeame  a 


In  addition  to  the 
German  tweets,  FanFan  began 
tweeting  in  English  again  in 
the  spring  of  2016.  His  tweets 
and  the  tweets  of  other 
Russian  trolls  were  spreading 
in  Ameriea.  The  narrative 
spread  by  the  trolls  was 
developing  a  symbiotic 
relationship  with  American 
right-wing  news  organizations 
like  Breitbart  and  its  followers 
on  social  media — a  group  of 
true  believers  in  the  Russian 


19  Chen,  “The  Agency.” 
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rallying  cry  for  Trump  supporters,  and  a  force-multiplying  tool  for  the 
Russian  trolls. 


The  Deplorable  Network 


In  a  September  speech,  Hillary  Clinton  made  the  following  remark 
to  a  group  of  potential  donors: 


You  know,  to  just  be  grossly  generalistic,  you  could  put  half 
of  Trump's  supporters  into  what  1  call  the  basket  of 
deplorable.  Right?  The  racist,  sexist,  homophobic, 
xenophobic,  Islamaphobic — ^you  name  it.  And  unfortunately 
there  are  people  like  that.  And  he  has  lifted  them  up.  He  has 
given  voice  to  their  websites  that  used  to  only  have  1 1,000 
people — now  1 1  million.  He  tweets  and  retweets  their 
offensive  hateful  mean-spirited  rhetoric.  Now,  some  of  those 
folks — they  are  irredeemable,  but  thankfully  they  are  not 
America. 


Clinton  went  on  in  the  same  speech  to  say  that  the  other  half  of 
Trump’s  supporters  were  just  people  who  felt  the  system  had  left  them 
behind,  who  needed  support  and  empathy.  Clearly,  she  was  not  referring 
to  all  of  Trump’s  supporters  as  deplorable,  but  the  narrative  quickly 
changed  after  social  media  users  began  referring  to  themselves  as 
“Deplorable”  in  their  screen  names. 

Before  the  “basket  of  deplorables”  comment,  the  trolls  primarily 
used  an  algorithm  to  respond  to  a  tweet  from  Donald  Trump  rapidly. 
Those  tweets  were  prominently  displayed  directly  under  Trump's  tweet  if 
a  user  clicked  on  the  original.  Those  users  became  powerful  voices  with 
large  followings;  Trump  himself  frequently  retweeted  many  of  those 
users. 20  However,  after  the  Clinton  speech,  a  “people  search”  on  Twitter 
for  “Deplorable”  was  all  one  needed  to  suddenly  gain  a  network  of 

20  K.  Thor  Jensen,  “Inside  Donald  Trump’s  Twitter-Bot  Fan  Club”  New  York  Magazine. 
June  15,  2016. 
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followers  numbering  between  3,000  and  70,000.  Onee  again,  FanFan’s 
name  ehanged,  this  time  to  “Deplorable  Luey”  and  the  profile  pieture 
beeame  a  white  middle-aged  female  with  a  Trump  logo  at  the  bottom  of 
the  pieture.  The  FanFan  follower  eount  went  from  just  over  1,000  to 
1 1,000  within  a  few  days.  His  original  network  from  the  Mizzou  and 
European  eampaigns  ehanged  as  well:  traeing  his  follower  trail  again  led 
to  the  same  groups  of  people  in  the  same  network,  and  they  were  all  now 
defined  by  the  “Deplorable”  brand.  In  short,  they  were  now  completely  in 
unison  with  a  vast  network  of  other  Russian  trolls,  actual  American 
citizens,  and  bot  accounts  from  both  countries  on  Twitter. 

With  a  large  network  consisting  of  Russian  trolls,  true  believers, 
and  bots,  it  suddenly  became  easier  to  get  topics  trending  with  a  barrage 
of  tweets.  The  Russian  trolls  could  employ  the  previously  used  tactics  of 
bot  tweets  and  hashtag  highjacking,  but  now  they  had  the  capability  to 
create  trends. 

Besides  creating  trends,  the  trolls  could  relay  strategy  under  the 
radar  using  Twitter.  That  is  to  say,  a  message  could  be  delivered  in  the 
form  of  a  picture  that  did  not  include  any  words.  The  lack  of  words  would 
spread  the  message  to  the  followers  in  a  timeline,  but  retweets  would  not 
develop  any  trends — only  that  network  of  followers  or  someone  actively 
observing  the  network  saw  the  messages.  Often,  anonymous  users 
discussed  the  tactics  behind  the  trend  creation  on  the  social  media  site 
4Chan,  on  the  bulletin  board  called  “/pol/”  and  subsequently 
coordinated  the  trend  within  the  Deplorable  Network  on  Twitter.  The 
most  effective  trends  derived  from  this  strategy  came  in  the  days 
following  the  “Access  Holl5Avood”  tape  release  in  which  Donald  Trump 
implied  that  he  was  able  to  touch  women  inappropriately  because  of  his 
fame.  The  Deplorable  Network  distributed  the  corresponding  strategy 
throughout  the  network  (Figure  10)  to  drown  out  negative  attention  to 
Trump  on  Twitter. 
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Coinciding  with  the  implementation  of  the  strategy  to  mask  anti- 
Trump  eomments  on  Twitter,  WikiLeaks  began  releasing  John  Podesta’s 
stolen  emails.  The  emails  themselves  revealed  nothing  truly 
eontroversial,  but  the  narrative  that  the  trending  hashtag  ereated  was 
powerful.  First,  the  issue  of  haeked  emails  developed  into  a  narrative 
eonflating  Podesta’s  emails  to  the  issue  of  Clinton’s  private  email  server. 
The  Clinton  server  was  likely  never  haeked,  but  the  problem  of  email 
loomed  over  the  candidate  as  an  indicator  of  her  seemingly  omnipresent 
issues  of  corruption.  The  corruption  narrative  also  plagued  the 
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Hi  /pol/. 

I'm  not  sure  I  can  really  put  into  words  how 
dire  this  is. 

I  have  inside  knowledge  of  the  DNC  and 
some  future  attacks  they  plan  to  levy  against  trump 
There’s  like  two  more  videos;  one  of  which  is  pretty  damning 
Next  one  is  a  generic  pervy  trump  It’s  not  that  shocking  but  it’s  purpose  is  to  further 
magnify  some  assault  charges  which  will  be  held  against  trump  after  the  debate 

The  second  one  is  pretty  bad.  It's  Trump  making  a  racist  remark. 

I’m  not  sure  I  can  effectively  communicate  how  important  it  is  somebody  counters  this. 

I've  thought  about  contacting  the  trump  campaign  but  I  found  out  they’re  implicated  in 
the  leaks  as  well. 

See.  around  50%  of  Trump  campaign  is  trying  to  Sabotage  him 
That’s  why  I'm  coming  to  you. 

There’s  two  steps  we  need  to  take  to  counter  these  leaks. 

1.  Starts  Monday,  4:00pm  central  We  start  a  hashtag  on  Twitter  called 
"#NextFakeTrumpVictim.  This  hashtag  may  not  make  sense  right  now  but  if  everything 
goes  according  to  plan  then  it'll  all  make  sense  come  Monday  We  need  to  flood  Twitter 
at  exactly  4  central  to  spread  this  tag  It  will  counter  the  fake  Monday  story 

2.  On  Friday  at  11.00am  central  we  start  the  hashtag  #Media'sNextTrumpLie 
Again,  this  will  make  sense  come  Friday 

This  is  pivotal.  Tell  everyone  you  know  to  start  these  tags  at  precisely  these  times. 

I  may  sound  like  I’m  role-playing  but  in  a  couple  days  you’ll  all  realize  I  was  legit. 

Please. 

This  IS  so  important. 


I  pray  you  guys  get  this  done  by  ail  measures 
You  can  change  the  narrative 

Figure  12.  Coordinating  hashtag  creation 

Source:  Screenshot  of  4Chan  post  circulated 
on  Twitter 


Democratic  National 
Committee  (DNC),  which 
experienced  a  hack  earlier  in 
the  year,  also  by  Russian 
sources  and  revealed  by 
WikiLeaks.2i 

Secondly,  the  Podesta 
email  narrative  took  routine 
issues  and  made  them  seem 
scandalous.  The  most 
common  theme:  bring 
discredit  to  the  mainstream 
media.  John  Podesta,  like 
any  campaign  manager  in 
modern  politics, 
communicated  with 
members  of  the  press. 

Emails  communicating  with 
reporters  were  distributed 
via  trending  tweets  with 


21  ODNI  Report,  2. 
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links  to  fake  news  websites.  The  fake  news  distorted  the  stolen  emails 
into  eonspiraeies  of  media  “rigging”  of  the  eleetion  to  support  Hillary 
Clinton. 

Finally,  the  stolen  emails  went  beyond  sharing  on  soeial  media. 

The  trend  beeame  so  sensational  that  traditional  media  outlets  had  to 
eover  the  Podesta  email  story,  whieh  gave  eredibility  to  the  fake  news  and 
the  assoeiated  online  eonspiraey  theories  promulgated  by  the  Deplorable 
Network.  The  WikiLeaks  release  of  the  Podesta  emails  was  the  peak  of 
Russian  command  of  the  trend  during  the  2016  election.  Nearly  every 
day  #PodestaEmail  trended  as  a  new  batch  of  supposedly  scandalous 
hacked  emails  made  their  way  into  the  mainstream  press. 

By  analyzing  the  followers  of  a  suspected  Russian  troll,  a  picture 
emerges  regarding  the  structure  of  the  network  that  was  active  during 
the  2016  election.  The  core  group  in  the  Deplorable  network  consisted  of 
Russian  trolls  and  popular  American  right-wing  accounts  like  Jack 
Posobiec,  Mike  Cernovich,  and  InfoWars  editor  Paul  Joseph  Watson. 
Figure  13  is  a  network  map  of  the  Deplorable  Network,  which  combines 
the  followers  of  two  bot  accounts  to  graph  the  overlapping  followers  of 
the  two  accounts.  The  small  cluster  in  the  center  is  the  core  group;  the 
ring  that  surrounds  it  is  the  bot  network. 
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The  remaining  nodes  are  individual  accounts  likely  consisting  of 
human-managed  accounts;  the  accounts  in  the  middle  have  more 
followers,  the  outside  accounts  with  weaker  links  have  fewer  followers.  In 
total,  the  Deplorable  Network  was  approximately  200,000  Twitter 
accounts  consisting  of  Russian  trolls,  true  believers,  and  hots.  Based  on 
my  analysis,  the  hot  network  appeared  to  be  between  16,000-34,000 
accounts.  22 


Figure  13.  Network  of  two  accounts 

Source:  Author 

Figure  14  shows  what  the  Deplorable  Network  looks  like  within  the 
larger  spectrum  of  American  political  networks  on  Twitter.  The  bright  red 
clusters  in  the  lower  right  of  the  network  map  were  accounts  that  only 
followed  Donald  Trump.  The  cohesiveness  of  the  group  indicates  how  a 
coordinated  effort  can  create  a  trend  in  a  way  that  a  less  cohesive 


22  This  count  is  based  on  analysis  of  the  followers  of  followers  of  suspeeted  troll 
aceounts  and  hots.  The  study  was  condueted  on  Mareh  15,  2016.  The  number  of 
aceounts  appears  to  have  redueed  dramatically  since  May,  following  the  French 
election,  implying  that  Twitter  suspended  some  of  the  aeeounts.  Unfortunately,  software 
limitations  prevent  this  analysis  from  being  more  aecurate.  Additionally,  it  is  nearly 
impossible  to  derive  the  exact  number  of  Russian  accounts  from  that  network  using  my 
available  resources. 
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Clinton  and  Trump  supporters 
live  in  their  own  Twitter  worlds 


Clinton 

Supporters 


Follow  only  Trump 
Follow  only  Clinton 
Follow  both 
Follow  neither 


Hillary  Clinton  supporters  in  this  user 
group  are  not  as  cohesive  as  Trump 
supporters  and  they  interact  more 
frequently  with  users  who  follow  both  or 
neither  candidate.  They  have  few  mutual 
follower  networks  in  common  with  the 
far-right  conservative  cluster. 


'  This  large  cluster  of  Trump 
supporters  on  Twitter  have  little 
mutual  follower  overlap  with  other 
users  and  are  a  remarkably 
cohesive  group.  They  exist  in  their 
own  information  bubble. 


Trump 

Supporters 


Source:  The  Electome  I  The  Laboratory  for  Social  Machines  at  the  MIT  Media  Lab 


Figure  14.  Network  map  of  Clinton  and  Trump  supporters 

Source:  “Parallel  Narratives”  Alex  Thompson,  Viee  News 


network  could  not  accomplish.  To  conduct  cyber-attacks  using  social 
media  as  a  weapon,  an  organization  must  have  a  vast  network  of  hot 
accounts  in  order  to  take  command  of  the  trend. 


Summary 


One  month  after  the  eleetion,  a  man  drove  from  his  home  in  North 
Carolina  to  Washington,  DC  to  uneover  the  truth  behind  a  news  story  he 
read  online.  He  arrived  at  Comet  Ping-Pong  pizza  with  an  AR-15, 
prepared  to  free  children  from  an  underground  child  sex  trafficking  ring 
in  the  restaurant.  After  searching  the  store,  he  found  no  children.  The 
story  was  a  hoax. 

One  of  the  emails  stolen  from  John  Podesta  was  an  invitation  to  a 
party  at  the  home  of  a  friend  that  promised  good  pizza  from  Comet  Ping 
Pong  and  a  pool  to  entertain  the  kids.  Fake  news  sites  reported  the  email 
as  code  for  a  pedophilic  sex  party;  it  was  widely  distributed  via  the 
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trending  #PodestaEmail  hashtag  and  an  associated  new  hashtag, 
#PizzaGate. 

The  #PizzaGate  hoax,  along  with  all  of  the  other  false  and  quasi- 
false  narratives  became  common  within  right-wing  media  as  another 
indication  of  the  immorality  of  Clinton  and  her  staff.  Often,  the 
mainstream  media  would  latch  onto  a  story  with  unsavory  backgrounds 
and  false  pretenses  also,  thus  giving  more  credibility  to  all  of  the  fake 
news;  however,  the  narrative  from  the  #PizzaGate  hoax  followed  the 
common  propaganda  narrative  that  the  media  was  trying  to  cover  up  the 
truth,  and  the  government  failed  to  investigate  the  crimes.  Ultimately, 
that  is  what  drove  the  man  to  inquire  into  the  fake  news  for  himself.  23 

With  unknown  factors  like  the  impact  of  fake  news,  the  true 
results  of  the  Russian  influence  operation  will  likely  never  be  known.  As 
Ellul  said,  experiments  undertaken  to  gauge  the  effectiveness  of 
propaganda  will  never  work  because  the  tests  “cannot  reproduce  the  real 
propaganda  situation. ”24  The  concept  itself  is  marred  by  the  fact  that 
much  of  the  social  media  support  Trump  received  was  through  real 
American  true  believers  tweeting.  However,  two  numbers  will  stand  out 
from  the  2016  election:  2.8  million  and  80,000.  Hillary  Clinton  won  the 
popular  vote  by  2.8  million  votes,  and  Donald  Trump  won  the  electorate 
via  a  combination  of  just  over  80,000  votes  in  three  key  states.  One  could 
easily  make  the  case — as  many  on  the  left  have  done — that  Hillary  lost 
because  of  the  Russian  influence. 23  Conversely,  one  could  also  argue  that 
Clinton  was  a  flawed  candidate  and  she  was  destined  to  lose  because  of  a 


23  Faiz  Siddiqui  and  Susan  Svrluga,  “N.C.  man  told  police  he  went  to  D.C.  pizzeria  with 
gun  to  investigate  conspiracy  theory.”  Washington  Post,  December  5,  2017. 

24  Ellul,  6. 

25  Many  on  the  left  have  mischaracterized  the  attack  as  “Russian  hacking  of  the 
election,”  which  has  in  turn  conflated  the  issue  of  the  John  Podesta  email  theft  with  a 
hacking  of  the  actual  election  systems.  To  be  clear:  there  is  no  evidence  of  any  sort  of 
hack  on  any  ballot  counting  systems,  only  evidence  outlined  in  this  paper  of  two  hacks 
(DNC  and  Podesta)  combined  with  an  influence /information  operation. 
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botched  campaign  combined  with  a  growing  sense  of  disenchantment 
with  the  American  political  system.  However,  one  cannot  dispute  the  fact 
that  Russia  launched  a  massive  cyber  warfare  campaign  to  influence  the 
election  for  Donald  Trump. 26 

Hillary  Clinton  has  been  a  target  of  political  scorn  from 
conservative  groups  since  she  first  came  into  the  national  spotlight  as 
First  Lady  in  the  90s.  Claiming  she  and  her  husband  were  victims  of  a 
“vast  right-wing  conspiracy”  early  in  President  Clinton’s  first  term 
seemed  h5^erbole  at  the  time. 27  Throughout  his  presidency,  however,  the 
Clinton  name  became  synonymous  with  scandal,  and  that  reputation 
would  follow  Hillary  into  her  political  foray.  Ultimately,  groups  on  the  left 
and  right  presented  strong  opposition  to  her  candidacy  in  2016,  which 
meant  that  Russian  trolls  already  had  a  narrative  to  build  upon  and  a 
network  of  true  believers  on  social  media  to  spread  their  propaganda. 

Obviously,  that  network  ultimately  became  the  Deplorable 
Network,  which  also  included  scorned  Bernie  Sanders  supporters,  the 
“Bernie  Bros.”  Together,  the  Russian  cyber  trolls  combined  efforts  with 
American  Twitter  accounts  to  discredit  Hillary  Clinton.  Additionally,  the 
Russian  trolls  spread  Russian  propaganda  to  bolster  Putin’s  image — 
particularly  regarding  Russian  involvement  in  Syria. 28 

For  the  most  part,  the  Russian  trolls  became  sawier  with  their 
techniques  as  they  adapted  to  the  influence  operation  in  the  United 
States.  However,  some  users,  like  FanFan,  were  sloppy  with  their 
tradecraft  and  were  obvious  to  anyone  monitoring.  The  trolls  were 
occasionally  sloppy  with  their  IP  address  locations  as  well.  Following  the 
first  presidential  debate,  the  #TrumpWon  hashtag  quickly  became  the 
number  one  trend  globally.  Using  the  TrendMap  application,  one  quickly 


26  ODNI  Report,  1 

27  Hanna  Rosin,  "Among  the  Hillary  Haters.”  The  Atlantic.  March  1,  2015,  63. 

28  Meyer  "War  Goes  Viral.” 
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noticed  that  the  worldwide  hashtag  seemed  to  originate  in  St.  Petersburg, 
Russia. 

Russian  trolls  gave  obvious  support  to  Donald  Trump,  but  the 
operation  also  ineluded  other  benefits  for  Russia  despite  the  winner  of 
the  Presideney:  Russia  proved  that  using  soeial  media  as  a  weapon  eould 
ereate  ehaos  on  a  massive  seale,  diseredit  any  politieian,  and  divide 
Ameriean  soeiety.  An  additional  benefit  for  Russia  is  the  more  favorable 
view  of  Russian  policy  and  Vladimir  Putin  and  Russia  as  a  whole.  Recent 
surveys  indicate  that  an  uptick  in  American  opinions  of  Russia  in  2016 
(Figure  11),  especially  amongst  Republican  voters,  of  whom  only  12% 
saw  Putin  favorably  in  2015,  versus  32%  in  2017.29 

Adrian  Chen,  the  New  York  Times  reporter  who  originally 
uncovered  the  troll  network  in  St.  Petersburg  in  2015,  went  back  to 
Russia  in  the  summer  of  2016.  Russian  activists  he  interviewed  claimed 
that  the  purpose  of  the  trolls  “was  not  to  brainwash  readers,  but  to 

Americans’  Opinions  of  Russia 

What  is  your  overall  opinion  of  Russia?  fs  it  very  favorable,  mostty  favorable,  mostly  unfavorable  or  very 

unfavorabJe"^ 

■  ■-  n  v  -  '  u-il*-  ■  infri  .  M  - 


-  L  L  i  J  p 

Figure  15.  Americans’  Opinions  of  Russia 

Souree:  Russia  Historieal  Trends,  Gallup 


29  Chris  Cillizza,  “Analysis:  Vladimir  Putin’s  popularity  is  soaring  among  Republicans.” 
The  Washington  Post.  Februaiy  21,  2017. 
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overwhelm  soeial  media  with  a  flood  of  fake  eontent,  seeding  doubt  and 
paranoia,  and  destroying  the  possibility  of  using  the  Internet  as  a 
demoeratie  spaee/’^o  The  troll  farm  used  similar  teehniques  to  drown  out 
anti-Putin  trends  on  Russian  soeial  media  in  addition  to  pumping  out 
disinformation  to  the  United  States. 

A  Congressional  Researeh  Serviee  Study  summarized  the  Russian 
troll  operation  sueeinetly  in  a  January  2017  report:  “Cyber  tools  were 
also  used  [by  Russia]  to  create  psychological  effects  in  the  American 
population.  The  likely  collateral  effects  of  these  activities  include 
compromising  the  fidelity  of  information,  sowing  discord  and  doubt  in 
the  American  public  about  the  validity  of  intelligence  community  reports, 
and  prompting  questions  about  the  democratic  process  itself. 

To  Russia,  information  warfare  is  a  specialized  type  of  war,  and 
modern  tools  make  social  media  the  weapon.  According  to  a  former 
Obama  administration  senior  official,  Russians  regard  the  information 
sphere  as  a  domain  of  warfare  on  a  sliding  scale  of  conflict  that  always 
exists  between  the  US  and  Russia. 32  This  perspective  was  on  display 
during  a  Russian  national  security  conference  “Infoforum  2016.”  Andrey 
Krutskih,  a  senior  Kremlin  advisor,  compared  Russia’s  information 
warfare  to  a  nuclear  bomb,  which  would  allow  Russia  to  talk  to 
Americans  as  equals,”  in  the  same  way  that  Soviet  testing  of  the  atomic 
bomb  did  in  1949.33 

Table  4.  Russia  Case  Study  Analysis  in  2016  Election 

Propaganda  1 .  Anything  discrediting  to  Hillary  Clinton 

Narratives  2.  News  media  hides  information 


30  Adrian  Chen,  “The  Real  Paranoia-Inducing  Purpose  of  Russian  Hacks.”  The  New 
Yorker.  July  27,  2016. 

31  Catherine  Theohaiy  and  Cory  Welt.  2017.  Russia  and  the  U.S.  Presidential  Election. 
CRS  Report  No.  IN10635.  Washington,  DC:  Congressional  Research  Service. 

32  David  Ignatius,  “Russia’s  radical  new  strategy  for  information  warfare.”  Washington 
Post.  January  18,  2017 

33  Ignatius. 
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3.  Politicians  are  rigging  the  system 

4.  Global  elite  trying  to  destroy  the  world 

5.  Globalism  is  taking  jobs  and  destroying  cultures 

6.  Refugees  are  terrorists 

7.  Russian  foreign  policy  is  strong  on  anti-terrorism 

8.  Democrats  and  some  Republicans  want  WWIII  with 
Russia 

True 

Believers 

Alt-right,  some  Bernie  Sanders  supporters,  followers  of 

Info  Wars  and  Breitbart,  4Chan  /pol/  users. 

Cyber 

Warriors 

Hackers  and  professional  trolls 

Bot  Network 

Large,  sophisticated  network  that  leveraged  cyber  warriors 
and  true  believer  accounts  to  create  the  “Deplorable 
Network.” 

Source:  Author 


From  2015-2016,  Russian  trolling  modus  operandi  took  a  logical 
path  from  small  stories  designed  to  create  panic  and  sow  seeds  of  doubt, 
to  a  social  media  machine  that  ISIS  could  only  imagine.  In  warfare 
strategy,  narrative  manipulation  through  social  media  cyber  operations 
is  the  current  embodiment  of  Douhet’s  theory  of  taking  the  fight  directly 
to  the  people.  The  2016  election  proved  that  using  social  media  to 
influence  political  outcomes,  as  opposed  to  violence  or  Cold  War-like 
posturing,  is  a  highly  effective  strategy  in  modern  warfare — a  strategy 
that  will  likely  continue  as  technology  continues  to  develop  and  adapt  to 
the  ever-growing  social  media  landscape  as  more  actors  gain  the  ability 
to  take  command  of  the  trend. 
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Chapter  4 


The  War  of  20— 

Right  now  in  Moscow,  they  must  be  clinking  vodka  glasses. 

Because  for  less  than  the  cost  of  a  MiG-29,  they  have  thrown 

the  West  into  complete  disarray. 

Thomas  Freidman  on  Meet  the  Press,  2017 

The  young  congresswoman  rolled  out  of  bed  later  than  anticipated 
on  her  first  Monday  back  in  Washington  after  a  busy  weekend.  Her 
schedule  had  been  packed  since  the  previous  Thursday  when  she  co¬ 
sponsored  a  bill  to  increase  funds  for  federal  employee  cyber  awareness 
training  right  after  taking  to  the  floor  as  the  leading  advocate  for  military 
action  in  a  troubled  part  of  the  world.  The  next  day  was  an  awards 
ceremony,  followed  by  dinner  at  the  State  Department  honoring  the  2019 
International  Women  of  Courage  (IWC),  who  were  recognized  for  their 
courageous  stands  in  the  face  of  adversity  from  their  governments.  All 
that  before  catching  a  late  flight  back  to  her  district  to  spend  the  rest  of 
the  weekend  with  her  chief  of  staff  filling  out  paperwork  and  registering 
online  domain  names  for  her  2020  Senate  run. 

She  was  polling  off  the  charts  in  her  state,  and  she  was  looking 
forward  to  another  productive  week  to  show  off  her  skills  in  Washington 
to  her  constituents  back  home.  Over  coffee,  she  unlocked  her  phone  to 
see  a  red  circle  with  “27. 5K”  over  her  Twitter  application.  Odd,  she 
thought,  normal  Twitter  traffic  to  her  account  usually  numbered  only  a 
few  dozen.  Suddenly,  a  chill  ran  through  her  spine.  As  a  member  of  the 
House  Intelligence  Committee,  and  a  self-proclaimed  cyber  expert,  she 
had  seen  things  like  this  before,  and  now  she  was  certain  that  she  was  a 
victim  of  an  online  smear  campaign.  Without  reading  any  of  the 
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messages  that  ineluded  her  Twitter  handle,  she  looked  at  the  trends.  The 
top  five  trends  at  that  moment:  her  name,  #terroristineongress, 
“eongresswoman  speeeh,”  “WWlll,”  and  “proof  of  abortion.” 

The  narrative  produeed  by  those  trends  was  an  odd  eombination  of 
eomplete  falsehoods  mixed  with  small  amounts  of  truth.  First,  one  trend 
revealed  haeked  emails  that  she  told  her  ehief  of  staff  that  she  “didn’t 
want  to  go  baek  to  that  plaee  beeause  of  what  happened  there  in  eollege.” 
In  reality,  she  was  talking  about  not  wanting  to  campaign  at  an  in-state 
rival  university  that  beat  her  and  her  volleyball  team  when  she  was  in 
college,  but  the  narrative  was  that  she  had  an  abortion.  The  trend  “proof 
of  abortion”  included  forged  documents  and  grotesque  pictures  as 
evidence  of  her  alleged  college  experience.  Additionally,  some  of  her  old 
tweets  from  college  were  being  retweeted,  each  of  which  she  thought  she 
deleted  when  she  first  ran  for  office  because  the  content  made  it  seem 
like  she  partied  too  much  over  one  particular  spring  break. 

Secondly,  “congresswoman  speech”  linked  to  a  Washington  Post 
article  that  mentioned  her  floor  speech  the  previous  week.  The  trend  was 
a  combination  of  average  people  sharing  the  link,  and  nefarious  hot 
accounts  that  included  the  words  “congresswoman  speech”  with  a 
narrative  that  she  was  trying  to  start  WWlll.  Of  course,  those  tweets  were 
the  genesis  of  the  other  trend,  “WWlll.” 

Most  frighteningly  of  all  of  the  trends  was  that  the  WWlll  trend 
also  claimed  she  was  tr3dng  to  unite  with  terrorists  to  fight  WWlll.  The 
tweets  included  a  video  of  her  wearing  a  headscarf  in  a  tent  with  Middle 
Eastern  Jihadists.  The  end  of  the  video  shows  the  group  praying 
together,  and  includes  the  audio  of  her  voice  saying,  “1  pray  with  you, 
and  support  you  always.”  These  tweets  included  the  last  trend, 
#terroristincongress . 

She  had  never  met  with  any  Jihadists  on  any  of  her  trips  to  the 
Middle  East,  and  she  had  certainly  never  uttered  those  words;  yet,  it 
appeared  to  be  her  in  the  first  scene  of  the  video,  and  her  voice  was  loud 
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and  clear  in  the  seeond.  She  remembered  that  she  had  a  still-photo  with 
a  Muslim  woman  at  the  IWC  event  the  previous  week.  The  woman  gave 
her  a  headsearf  as  a  gift,  and  she  wore  it  briefly  for  the  photo. 

She  turned  on  her  television.  Every  morning  show  was  talking 
about  her.  Beeause  the  story  broke  on  Monday,  she  already  knew  that 
the  24-hour  eable  news  networks  would  eover  her  alleged  seandals  for 
the  rest  of  the  week.  The  eongresswoman’s  reputation  was  shattered.  She 
could  easily  deny  all  of  the  claims,  but  this  barrage  attack  on  her 
character  and  her  motives  would  most  likely  kill  her  future  political 
ambitions — and  the  policy  agenda  she  outlined  in  Congress. ^ 


Old  Meets  New 

Douhet  titled  the  final  ehapter  of  his  book  “The  War  of  19 — .”  The 
eonelusion  was  a  fietional  aeeount  of  how  he  believed  the  next  war  would 
be  fought  based  on  his  assessment  of  eurrent  teehnology.  His  story 
included  the  notion  that  future  wars  would  end  once  a  side  gained 
command  of  the  air,  subsequently  influencing  the  will  of  the  population 
to  demand  their  government  change  the  state’s  strategic  direction.  The 
fictional  account  to  start  this  chapter  is  a  very  real  possibility  based  on 
current  technology  and  the  use  of  social  media  as  a  weapon  by  gaining 
command  of  the  trend  to  influence  the  will  of  the  population  to  change 
the  state’s  strategic  direction.  In  the  example,  a  rising  star  in  politics  was 
smeared.  Her  agenda  included  a  strong  foreign  policy  against  an 


1  Each  trend  in  the  fictional  account  is  based  on  similar  attacks  on  Twitter  of  various 
public  figures.  One  thing  worth  noting  is  the  fake  video.  Current  technologies  used  by 
some  social  media  apps,  like  Snapchat,  create  an  “augmented  reality.”  As  this 
technology  advances,  scenes  like  this  fictional  account  will  be  able  to  be  created  by 
anyone  with  a  smart  phone  and  a  picture  of  the  target.  Additionally,  various  “lip-dub” 
and  “auto-tuned”  parody  videos  are  generally  entertaining,  but  a  bad  actor  could  easily 
use  those  same  techniques  to  create  audio  forgeries.  Washington  Post  technology 
columnist  Avi  Selk  recently  previewed  of  this  new  technology  in  his  article  “This  audio 
clip  of  a  robot  as  Trump  may  prelude  a  future  of  fake  human  voices.” 
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adversary,  and  she  was  a  leading  voiee  of  military  aetion  against  that 
partieular  eountry.  Those  plans  would  be  sidelined  after  a  targeted 
eampaign  distraeting  the  eountry  with  falsehoods. 

Smear  eampaigns  have  been  around  sinee  the  beginning  of  polities, 
but  the  fietional  example  in  this  paper  illustrated  novel  teehniques 
reeently  employed  by  foreign  state  aetors  and  terrorist  groups,  with  eaeh 
attaek  gaining  popularity  and  eredibility  after  trending  on  Twitter.  The 
attacks,  often  under  the  guise  of  a  “whistleblower”  campaign,  make  the 
routine  seem  scandalous.  Additionally,  WikiLeaks  advertises  that  they 
have  never  published  an5hhing  requiring  retraction  because  everything 
they  have  posted  is  supposedly  authentic  stolen  material.  Just  like  the 
Podesta  email  releases,  several  politicians  and  business  leaders  around 
the  world  have  fallen  victim  to  this  type  of  attack. 

People  likely  remember  the  2015  North  Korean  hacking  of  Sony 
Studios  to  retaliate  for  a  movie  depicting  the  assassination  of  Kim  Jong- 
un.  Lost  in  the  explosive  nature  of  the  hacking  story  is  that  the  fallout  at 
the  company  was  not  because  of  the  hacking  itself  but  from  the  release 
of  embarrassing  emails  from  Sony  senior  management,  as  well  as  the 
salaries  of  every  employee  at  Sony.  The  uproar  over  the  content  of  the 
emails  dominated  social  media,  often  fed  by  salacious  stories  like  the  RT 
headline:  “Leaked  Sony  emails  exhibit  wealthy  elite’s  maneuvering  to  get 
child  into  Ivy  League  school.”  Ultimately,  Sony  fired  a  senior  executive 
because  of  the  content  of  her  emails. 2 

As  1  write  this  theory  of  future  warfare,  the  French  are  going  to  the 
polls  to  elect  a  new  president  only  48-hours  after  nine  gigab5rtes  of  email 
stolen  from  the  Emmanuel  Macron  campaign  were  released  online  and 
verified  by  WikiLeaks.  Subsequently,  the  hashtag  #MacronLeaks  rose  to 
the  number  one  worldwide  trend  in  an  influence  operation  resembling 


2  “Ex-Sony  Chief  Amy  Pascal  Acknowledges  She  Was  Fired.”  NBCNews.com,  February 
12, 2015 
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the  #PodestaEmail  campaign  with  a  supporting  cast  of  some  of  the  same 
actors. 

I  have  observed  during  the  weeks  preceding  the  French  Election 
that  many  accounts  within  the  Deplorable  Network  have  changed  their 
names  to  support  Macron’s  opponent,  Marine  LePen.  These  accounts 
mostly  Tweet  in  English  and  still  engage  in  American  political  topics  as 
well  as  French  issues.  Some  of  the  accounts  also  Tweet  in  French  and  a 
new  network  of  French-tweeting  hot  accounts  uses  the  same  methods  as 
the  Deplorable  Network  to  take  command  of  the  trend.  Additionally,  the 
political  left  in  the  United  States  seems  to  have  a  large  group  of  hot 
accounts  forming  around  the  “Resist”  movement.  To  this  point,  it  is 
unclear  whether  those  accounts  are  foreign  cyber  warriors  or  hots,  but 
external  actors  can  certainly  feed  off  the  underl5dng  narratives  and  tap 
into  existing  networks  of  true  believers. 

Actors  like  North  Korea  and  Russia  have  significantly  more 
resources  and  are  better  equipped  to  exploit  social  media  than  their  non¬ 
state  counterpsrts;  still,  as  Chapter  2  demonstrated,  non-state  actors 
like  ISIS  can  use  social  media  as  a  weapon  to  spread  propaganda,  which 
bolsters  recruiting  in  addition  to  serving  as  a  low-cost  pseudo-terror 
attack  without  actually  committing  any  resources  toward  international 
terrorism. 


Future  Warfare 

In  his  book.  Out  of  the  Mountains,  David  Kilcullen  describes  a 
future  comprised  of  large,  coastal  urban  areas  filled  with  potential 
threats,  all  connected. ^  The  implications  of  his  prediction  are  two-fold. 
First,  networks  of  malicious  non-state  actors  can  band  together  to 


3  David  Kilcullen,  Out  of  the  Mountains:  The  Coming  Age  of  the  Urban  Guerrilla.  (New 
York:  Oxford  University  Press,  2013),  231. 
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weaponize  social  media  using  a  template  similar  to  ISIS.  Although  these 
groups  may  not  have  the  power  to  ereate  global  trends,  they  ean  eertainly 
ereate  ehaos  with  smaller  numbers  by  hijaeking  trends  and  ereating  loeal 
trends.  With  minimal  resourees,  a  small  group  ean  ereate  a  hot  network 
to  amplify  its  message.  Seeond,  seores  of  people  with  exposure  to  soeial 
media  are  vulnerable  to  online  propaganda  efforts.  In  this  regard,  state 
aetors  ean  use  the  Russian  playbook. 

Russia  will  likely  continue  to  dominate  this  new  battlespace. 

Russia  has  intelligence  assets,  hackers,  cyber  warrior  trolls,  massive  hot 
networks,  state-owned  news  networks  with  global  reach,  and  established 
networks  within  the  countries  Russia  seeks  to  attack  via  social  media. 
Most  importantly,  the  Russians  have  a  history  of  spreading  propaganda 
using  a  method  they  perfected — active  measures  and  disinformation. 

After  the  2016  elections  in  the  United  States,  Russian  trolls  again 
worked  toward  influencing  European  elections.  Currently,  Russian  trolls 
are  active  in  France,  the  Balkans,  and  the  Czech  Republic  using  active 
measures  and  weaponized  social  media  messages. ^  It  is  clear  that  other 
countries  are  attempting  to  build  capabilities  to  match  the  Russian  cyber 
troll  influence. 

Already,  Turkey,  Iran,  and  Venezuela  are  noted  as  having  hot 
networks  and  eyber  warriors  similar  to  Russian  trolls.^  With  these  other 
states,  a  popular  use  for  the  trolls  in  the  soeial  media  battlespaee  is  to 
stoke  nationalism  and  eontrol  the  narrative  within  their  own  borders.  For 
example,  the  fake  Twitter  followers  of  Venezuelan  President  Nieolas 
Maduro  number  so  many  that  he  is  now  the  “third-most-retweeted  publie 
figure  in  the  world,  behind  only  the  king  of  Saudi  Arabia  and  the  pope.”^ 


Anthony  Faiola,  “As  Cold  War  turns  to  Information  War,  a  new  fake  news  police 
combats  disinformation.”  The  Washington  Post,  January  22,  2017. 

5  Meyer,  “War  Goes  Viral.” 

®  Meyer,  “War  Goes  Viral.” 
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With  a  large  enough  hot  network,  states  ean  also  eontrol  messages 
outside  of  soeial  media  using  similar  teehniques.  Manipulating  seareh 
engines  is  ealled  “seareh  engine  optimization,”  whieh  uses  hot  aeeounts 
to  inerease  the  number  of  elieks  to  a  partieular  web  page  after 
performing  a  seareh.  The  seareh  engine  algorithm  then  prioritizes  that 
page  in  response  to  subsequent  searehes  using  the  same  ke5Avord. 

Figure  1 5  shows  a  sereen  eapture 
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'It's  not  how  hacking  works': 
Anonymous  activist  deconstructs 
ODNI ... 

RT-Jan11,2017 

Assange  blasts  'embarrassing'  ODNI 
report,  says  'no  evidence'  given 
RT- Jan  9,  2017 

V  Related  coverage 

'Insider  leaks,  not  Russian  hacking': 
CIA  &  MIS  veterans  discuss  ... 
RT-JanlO,  2017 


'ODNI  report  speculative,  serves  to 
push  certain  political  theories  ... 
RT- Jan  9,  2017 


'Witch  hunt':  Kremlin  slams  ODNI 
report  claiming  Russia  hacked  US  ... 
RT- Jan  9.  2017 


of  a  Google  search  for  “ODNI 
Report.”  All  of  the  results  are  RT 
articles  lambasting  the 
intelligence  assessment  that 
named  the  Russian  government 
as  the  perpetrators  behind  the 
2016  election  interference. 

Techniques  like  search 
engine  optimization  and 
command  of  the  trend  will 
become  common  in  future  wars 
to  sow  discord  and  spread  false 
information,  with  the  aim  of 
causing  the  other  side  to  change 
its  course  of  action.  These  online 
weapons  should  frighten  every 
leader  in  a  democracy.  Perhaps 
most  frightening  is  the  Oxford 
Internet  Institute  Unit  for 

Figure  16.  Google  Search  of  "ODNI  Propaganda  discovery  that 
Report" 

Source:  Author  screenshot  “hundreds  of  thousands  of 

‘sleeper  hots’  exist  on  Twitter.”  These  hots  are  accounts  that  are  active 
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^  Cadwalladr,  18 
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but  have  not  yet  started  tweeting.  Researehers  do  not  know  who  owns 
the  aeeounts,  or  what  will  trigger  them. 

The  ease  of  use  and  large  numbers  of  aetive  bots  and  sleeper  bots 
indieate  a  high  likelihood  of  soeial  media  eontinuing  to  be  used  as  a 
weapon,  espeeially  as  more  and  more  state  and  non-state  organizations 
realize  the  impaet  they  ean  make  on  an  adversary.  ISIS  and  Russia  are 
models  for  this  future  war  that  uses  soeial  media  as  a  weapon.  As 
technology  improves,  techniques  are  refined,  and  internet  connectivity 
continues  to  proliferate  around  the  world,  this  sa5dng  will  once  again  ring 
true:  he  who  controls  the  trend  will  control  the  narrative,  and  ultimately 
the  narrative  controls  the  will  of  the  people. 
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Conclusion 


In  the  1987  book,  Truth  Twisters,  Richard  Deacon  laments  the 
future  of  independent  thinking,  as  computers  “could  become  the  most 
dangerous  hypnotic  influence  in  the  future.  Allowing  oneself  to  be 
manipulated  and  controlled  by  it.”i  He  believed  that  such  technology 
could  lead  one  to  commit  treason  without  realizing  any  manipulation. 
Propaganda  is  a  powerful  tool  and,  used  effectively,  it  has  been  proven  to 
manipulate  populations  on  a  massive  scale.  The  weaponization  of  social 
media  and  the  command  of  the  trend  make  the  spread  of  propaganda 
easier  than  ever  before  for  both  state  and  non-state  actors. 

Certainly,  the  spread  of  propaganda  is  faster,  cheaper,  and  has  a 
wider  reach  due  to  the  confluence  of  technical  and  social  factors.  Web 
2.0  allowed  the  average  internet  user  to  go  from  consumer  of  information 
to  producer  of  information.  From  that,  the  rise  of  social  media  as  a 
network  builder  solidified  viewpoints  existing  within  each  homophilic 
network.  Then,  blogs,  video  uploads,  and  social  media  enabled  the 
“citizen  reporter.”  Suddenly,  anyone  with  an  opinion  and  internet  access 
could  share  his  or  her  thoughts  with  anyone  within  their  network  willing 
to  listen. 

Occurring  simultaneously  with  social  media’s  rise  in  popularity 
was  the  shift  from  print  media  to  online  media.  Social  media  allowed 
users  to  scan  and  share  stories  to  their  followers  quickly.  For  journalists, 
the  movement  of  news  to  social  media  forced  them  to  adapt  their  content 
to  a  more  “clickable”  style — shorter  headlines,  frequent  posting,  and 
more  hyperbole  to  compete  with  other  journalists  as  well  as  popular 
bloggers.  Journalists  also  began  using  social  media — particularly 
Twitter — as  a  source  for  breaking  news.  The  result  was  questionable 

1  Richard  Deacon,  The  Truth  Twisters.  (London:  Macdonald,  1987),  95. 
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content  could  make  its  way  to  journalists  who  were  quick  to  push 
narratives  without  verification,  in  an  attempt  to  compete  with  other 
voices  on  Twitter.  In  short,  social  media  can  now  weaponize  fake  news, 
which  could  find  its  way  into  the  real  news. 

The  problem  with  using  social  media  as  a  weapon  is  the  structural 
hole.  Generally,  networks  of  opinions  tend  to  isolate  themselves,  creating 
an  echo  chamber  of  thoughts  and  ideas.  Homophily  has  been  both  a 
blessing  and  a  curse  to  propagandists  for  centuries.  Propaganda  is 
believable  to  an  individual  with  a  predisposition  toward  a  particular 
narrative.  Conversely,  a  person  with  an  outside  viewpoint  will  shun  new 
ideas  and  opinions  from  a  different  perspective.  In  other  words,  the  two 
groups  were  not  communicating  with  each  other  online,  which  is  evident 
in  the  map  of  Clinton  and  Trump  supporters  in  Figure  14.  To  cross 
networks,  a  message  must  first  traverse  the  gap  between  the  two 
networks — the  structural  hole — social  media  enables  that  form  of 
information  sharing  with  the  trending  topics  list.  For  anyone  trying  to 
spread  propaganda,  the  trending  tool  became  the  most  efficient  method. 

ISIS  was  the  first  organization  to  harness  the  power  behind  the 
trend.  Without  a  doubt,  ISIS’  presence  online  gave  the  group  an  air  of 
strength  and  power  that  the  group  did  not  have.  The  ISIS  brand, 
combined  with  a  cleverly  designed  hot  network  capable  of  hijacking  and 
creating  trends,  made  the  group  seem  as  if  it  were  an  existential  threat 
worldwide.  The  group  itself  does  not  claim  to  be  a  terrorist  organization, 
but  terror  threats  through  trends  spread  their  propaganda  containing 
horrifying  images  of  their  brutal  executions,  which,  in  turn,  served  as  de 
facto  acts  of  terror.  Additionally,  the  group  thrived  off  the  recruiting 
potential  of  social  media  using  the  same  messaging  and  branding 
techniques.  ISIS  proved  that  a  non-state  organization  could  weaponize 
social  media  by  taking  command  of  the  trend  to  meet  their  objectives. 

Regarding  state  actors,  Russia  is,  and  always  has  been,  the  biggest 
player  in  the  worldwide  spread  of  propaganda.  Dating  back  to  the  Cold 
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War,  the  Soviets  developed  a  style  of  spreading  false  information  that 
uses  a  variety  of  resourees  to  disseminate  disinformation.  Russian  aetive 
measures  are  still  in  use  today  and  are  made  more  powerful  through  the 
use  of  soeial  media.  Russia’s  military  organization  of  eyber  trolls, 
haekers,  and  botnets  highlights  the  state  foeus  of  resourees  and  efforts 
in  the  information  domain. 

While  Russia  is  the  largest  state  aetor  with  the  ability  to  take 
command  of  the  trend,  others  are  joining.  Several  countries  are  using  the 
Russian  template  to  build  their  disinformation  cyber  trolls,  and  the 
existence  of  new  hot  accounts  demonstrates  that  future  warfare  will 
continue  to  include  social  media  as  a  weapon  in  the  information  warfare 
domain. 

Thus  far,  the  United  States  response  has  been  relatively  weak.  For 
one  thing,  the  United  States  government  does  not  prioritize  information 
operations  the  way  it  once  did  during  the  Cold  War.  When  Eisenhower 
started  the  United  States  Information  Agency,  the  objective  was  to 
compete  with  Soviet  propaganda  around  the  world.  The  mission 
statement  of  USIA  clarified  its  role:  “The  purpose  of  the  United  States 
Information  Agency  shall  be  to  submit  evidence  to  peoples  of  other 
nations  by  means  of  communication  techniques  that  the  objectives  and 
policies  of  the  United  States  are  in  harmony  with  and  will  advance  their 
legitimate  aspirations  for  freedom,  progress,  and  peace. ”2 

Knowing  what  we  know  now  about  Russian  disinformation  active 
measures,  USIA  was  never  truly  equipped  to  fight  an  information  war. 

The  agency  became  a  public  diplomacy  platform  with  a  positive  message, 
not  the  negative  smear  tactics  the  Soviets  were  using  to  attempt  to 
discredit  the  United  States.  Accordingly,  several  questions  arose  at  that 
time:  should  USIA  spread  propaganda?  Should  it  seek  out  and  attempt  to 


2  Malcolm  Mitchell,  Propaganda,  Polls,  and  Public  Opinion:  Are  the  People  Manipulated? 
(Englewood  Cliffs,  N.J.:  Prentice-Hall,  1977),  12. 
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remove  negative  publieity  about  the  US?  Should  it  slander  opponents? 
Most  importantly:  should  it  do  any  or  all  of  these  things  when  the 
Ameriean  publie  eould  be  influeneed  by  a  message  intended  for  an 
international  audienee?^ 

Those  problems  still  exist  today,  and  the  government  laeks  a 
eentralized  information  authority  sinee  the  mission  of  USIA  was  relegated 
to  the  Department  of  State.  Several  failed  attempts  to  eounter  ISIS  on 
Twitter  show  the  weakness  that  the  US  government  has  when  trying  to 
use  social  media  as  a  weapon.  One  example  is  through  the  Center  for 
Strategic  Counterterrorism  Communications,  created  in  2010,  which 
started  the  program  “Think  Again  Turn  Away,”  and  awarded  a  $575,046 
contract  to  a  Virginia-based  consulting  firm  to  manage  the  project. ^  The 
intent  was  to  curb  the  appeal  of  ISIS  by  creating  a  counter- narrative  to 
the  ISIS  message  on  social  media.  Unfortunately,  the  Twitter  campaign 
had  undesirable  consequences  after  the  account  sent  tweets  arguing  the 
finer  points  of  the  Islamic  faith  with  ISIS  sympathizers.  Rita  Katz  best 
summarized  the  failure:  “In  order  to  counter  a  problem,  one  must  first 
study  it  before  adopting  a  solution.  Had  the  people  behind  “Think  Again, 
Turn  Away”  understood  jihadists’  mindsets  and  reasons  for  their 
behavior,  they  would  have  known  that  their  project  of  counter-messaging 
would  not  only  be  a  waste  of  taxpayer  money  but  ultimately  be 
counterproductive . 

In  the  end,  the  “Think  Again,  Turn  Away”  campaign  was  almost 
comical  as  it  could  not  communicate  effectively  with  any  audience  and 
severely  discounted  the  importance  of  its  message.  Jacques  Ellul  noted 
that  democracies  were  prone  to  having  problems  with  outward 


3  Mitchell,  13. 

Rebecca  Carroll,  “The  State  Department  Is  Fighting  With  ISIL  on  Twitter.”  Defense 
One.  June  25,  2014. 

3  Rita  Katz,  “The  State  Department’s  Twitter  War  with  ISIS  Is  Embarrassing.”  Time 
Magazine,  September  16,  2014. 
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communication  through  propaganda.  Because  demoeraeies  rely  on 
presenting  an  image  of  fairness  and  truth,  “propaganda  made  by 
demoeraeies  is  ineffeetive,  paralyzed,  medioere.”^  The  United  States  was 
ill-equipped  to  eombat  Soviet  aetive  measures  during  the  Cold  War,  and 
we  remain  unable  to  eompete  using  soeial  media  as  a  weapon. 

Unfortunately,  eountering  Russian  influenee  operations  has  taken 
a  partisan  slant  as  well.  Many  Republieans  downplay  the  Russian  role  in 
the  2016  election  because  admitting  the  effects  could  weaken  the 
political  capital  of  President  Trump’s  administration.  On  the  other  hand. 
Democrats  appear  to  be  so  blinded  by  the  Russian  operation  that  they 
cannot  see  the  underl5dng  conditions  that  allowed  for  the  spread  of  that 
narrative  in  the  first  place. ^  With  the  two  parties  unable  to  reach  a 
consensus  on  what  happened  and  the  impact  of  the  operation,  they  fail 
to  realize  that  as  technology  improves  and  proliferates  around  the  world, 
disinformation  campaigns  and  influence  ops  will  become  the  norm.  The 
fictional  candidate  at  the  beginning  of  Chapter  4  could  be  from  either 
party,  and  the  attack  in  a  future  war  in  the  information  sphere  could 
come  from  any  of  the  several  countries  attempting  to  build  an  online 
army  in  the  mold  of  Russia’s  trolls  and  hot  network. 

Fortunately,  social  media  companies  are  taking  steps  to  combat 
the  weaponization  of  their  mediums.  Facebook  has  been  at  the  forefront 
of  teeh  eompanies  taking  aetion  to  inerease  awareness  of  fake  news,  and 
a  proeess  for  removing  the  links  from  the  website.®  Also,  although 
Faeebook  trends  are  less  important  to  information  warfare  than  Twitter 
trends,  the  website  has  taken  measures  to  ensure  that  humans  are 
involved  in  making  the  trends  list.  Furthermore,  Twitter  has  started 
disereetly  removing  unsavory  trends  within  minutes  of  their  rise  in 

6  Ellul,  241. 

^  Adrian  Chen,  “The  Propaganda  about  Russian  Propaganda”  The  New  Yorker, 
December  1,  2016. 

8  Michelle  Castillo,  “Facebook  found  fake  accounts  leaking  stolen  info  to  sway 
presidential  election.”  CNBC.com,  April  27,  2017. 
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popularity.  Of  course,  adversaries  adapt  in  warfare;  thus,  Twitter  trolls 
have  attempted  to  regain  eommand  of  the  trend  by  misspelling  a 
previous  trend  onee  it  is  taken  out  of  eireulation.  Still,  even  if  the 
misspelled  word  regains  a  spot  on  the  trend  list,  the  message  is 
diminished. 

The  measures  enaeted  by  Faeebook  and  Twitter  are  important  for 
preventing  future  wars  in  the  information  domain.  However,  Twitter  will 
also  continue  to  have  problems  with  trend  hijacking  and  hot  networks. 
As  demonstrated  by  #PrayforMizzou  and  #WorldCup2014,  real  events 
happening  around  the  world  will  maintain  popularity  as  well-intending 
users  want  to  talk  about  the  issues.  In  reality,  removing  the  trends 
function  could  end  the  use  of  social  media  as  a  weapon,  but  doing  so 
could  also  devalue  the  usability  of  Twitter.  Rooting  out  hot  accounts 
would  have  an  equal  effect  since  that  would  nearly  eliminate  the 
possibility  of  trend  creation.  Unfortunately,  that  would  have  an  adverse 
impact  on  advertising  firms  who  rely  on  Twitter  to  generate  revenue  for 
their  products. 

With  social  media  companies  balancing  the  interests  of  their 
businesses  and  the  betterment  of  society,  other  intuitions  must  respond 
to  the  weaponization  of  social  media.  In  particular,  the  credibility  of  our 
press  and  our  politicians  have  been  put  into  question  by  social  media 
influenee  eampaigns — those  groups  should  respond  aeeordingly.  For 
instanee,  news  outlets  should  adopt  soeial  media  poliey  for  their 
employees  whieh  eneourage  the  use  of  soeial  media  but  diseourage  them 
from  rel5dng  on  Twitter  as  a  souree.  This  will  require  a  eulture  shift 
within  the  press  that  is  outside  of  the  seope  of  this  paper  but  fortunately 
has  gathered  signifieant  attention  at  universities  researehing  the  media’s 
role  in  the  influenee  operation.  It  is  worth  noting  that  the  Freneh  press 
did  not  eover  the  eontent  of  the  Maeron  leaks;  instead,  the  journalists 
eovered  the  haeking  and  influenee  operation  without  giving  any 
eredibility  to  the  leaked  information. 
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Finally,  our  elected  officials  must  move  past  the  partisan  divide  of 
Russian  influence  in  the  2016  election.  This  involves  two  things:  first, 
both  parties  must  recognize  what  happened — neither  minimizing  nor 
overplaying  Russian  active  measures.  Second,  and  most  importantly, 
politicians  must  commit  to  not  using  active  measures  to  their  benefit. 
Certainly,  the  appeal  of  free  negative  advertising  will  make  any  politician 
think  twice  about  using  disinformation,  but  the  reality  of  a  foreign 
influence  operation  damages  more  than  just  the  other  party,  it  damages 
our  democratic  ideals.  Senator  John  McCain  summarized  this  sentiment 
well  at  a  CNN  Town  Hall  when  he  said,  “Have  no  doubt,  what  the 
Russians  tried  to  do  to  our  election  could  have  destroyed  democracy. 
That's  why  we've  got  to  pay  a  hell  of  a  lot  more  attention  to  the  Russians 
and  the  things  they're  doing  in  Europe — and  right  now,  they're  trying  to 
determine  the  outcome  of  the  French  election,  and  they're  using  cyber. 

This  was  not  the  cyber  war  we  were  promised.  Predictions  of  a 
catastrophic  cyber-attack  dominated  policy  discussion,  but  few  realized 
that  social  media  could  be  used  as  a  weapon  against  the  minds  of  the 
population  until  ISIS  started  spreading  their  propaganda  in  2014.  Since 
then,  the  command  of  the  trend  has  gained  importance  in  this  new 
battlespace  as  Russia  used  social  media  to  conduct  a  massive  influence 
operation  against  the  United  States.  Thus,  nearly  100  years  later, 
Douhet’s  idea  that  attacking  the  people  would  cause  them  to  rise  and 
demand  change  from  their  government  was  realized;  however,  the  means 
for  implementing  that  change  was  not  the  command  of  the  air — it  was 
the  Command  of  the  Trend. 


^  Eric  Bradner,  "At  CNN  town  hall,  McCain  and  Graham  give  their  view  of  Trump's 
presidency  so  far.”  CNN.com,  March  2,  2017. 
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